The multimodal representations induced by our models should be better suited than purely textbased vectors to label or retrieve images.
given that the quantitative and qualitative results collected so far suggest that the models propagate visual information across words, we apply them to image labeling and retrieval in the challenging zeroshot setup (see Section 2 above).