We seek to extensively study this aspect, particularly with respect to temporal prepositions (Pratt-Hartmann, 2004).
we collect the TEMPOral reasoning in video and language (TEMPO) dataset which builds off the recently collected DiDeMo dataset (Hendricks et al., 2017).