We leverage these annotations to obtain the ground truth visual groundings (A V ) for the referents in our questions.
each of the caption and question templates has referring phrase annotations in them, thus giving the ground truth textual groundings (A T ).