In both cases, the textual data directly describes image content, thus enabling the above-mentioned lines of research.
these datasets are often restricted to English language text and typically of relatively broad domain; The FLICKR caption datasets for instance contain images including landscapes, animals, and everyday scenes while the COCO dataset is similarly broad but contains more items per image.