Harwath et al. (2018) focus on speech, exploring how spoken captions in two languages can be used simultaneously to improve performance in an English-Hindi parallel subset of the Places-205 dataset (Zhou et al., 2014).
our experiments concern the setting where speech data from a low-resource language is used in conjunction with corresponding translated written captions.