Previous works (Yin and Ordonez, 2017; have found explicit object detections to be informative for image description generation.
we base our intuition on the hypothesis that a thorough and true description of the image should consist of information about objects and their interactions (frequencies, etc.)