We argue that what is crucial to the cross-modality attention layer is the ability to selectively enrich the semantic representation of a sentence through the aid of an image.
we need to avoid introducing noises resulted from when the image fails to represent some semantic meaning of words, such as abstract concepts.