Video Question Answering: Since caption generation can only describe observable events, recent work seeks to move closer to comprehension, by learning to answer complex questions about videos.
the datasets used for Video QA (Yang et al., 2003;Xu et al., 2016;Zhu et al., 2017) focus only on directly evident visual concepts and construct the questions mostly about "where" and "what" aspects.