Consequently, we construct baselines relying solely on captions and ground truth bounding box locations that are comparable to our task.
running the Stanford Scene Graph Parser (Schuster et al., 2015) on ground truth captions constructs a scene graph just from the image captions (which almost never capture all the information present in an image).