Through careful analysis of the results attained by state-of-the-art learning models and human annotators on existing datasets, we show that the design of the decoy answers has a significant impact on how and what the learning models learn from the datasets.
the resulting learner can ignore the visual information, the question, or both while still doing well on the task.