To utilize these candidate caption sets, we employ an intra-pair hard negative mining strategy.
during the optimization, we add an extra loss term: In our implementation, the candidate set C has approximately 1, 000 samples.