In another related task -referring expression comprehension (Kazemzadeh et al., 2014;Mao et al., 2016;Hu et al., 2017) -the model has to identify which object in the image is being referred to by the given sentence.
similar to prior work (Xu et al., 2015), we extract features using a lower level convolutional layer instead of fully connected layer.