In this paper, we focus on the foiled captions classification task (Section 2), and propose the use of explicit object detections as salient image cues for solving the task.
to methods from previous work that make use of word based information extracted from captions (Heuer et al., 2016;Yao et al., 2016;Wu et al., 2018), we use explicit object category information directly extracted from the images.