The key difference between our module and theirs lies in the input features and the caption supervision.
we use the question-attended image features V q as inputs, and only use the most relevant caption, which is automatically determined in an online fashion (detailed below), for each question-image pair to train the captioning module.