We employ the Polylingual Topic Model (Mimno et al., 2009), which is originally used to model corresponding documents in different languages that are topically comparable, but not parallel translations.
we employ our previous work (Mason and Charniak, 2013) which extends this model to topically similar images and natural language captions.