5 Cross-modal experiments In the cross-modal experiments, we induce a mapping from visual to linguistic space.
given an image, we apply the mapping to its visual vector representation to obtain an estimate of its representation in linguistic space, where the word associated to the nearest neighbour is retrieved as the image label.