On the other hand, for real-world datasets, taking the max in loss function tends to be very sensitive to label noise, resulting in fake negative samples.
given an image-caption pair (i, c), we employ human heuristics and WordNet knowledge base to generate contrastive negative samples C (c).