Recognizing relationships between entities is non-trivial because the space of possible relationships is immense, and because there are O(n 2 ) relationships possible when n objects are present in an image.
while image captions are easier to obtain, they are often not ⇤ Equal Contribution completely descriptive of an image (Krishna et al., 2017).