Effectiveness of new decoys A better set of decoys will force learning models to integrate all 3 pieces of information -images, questions and answers -to make the correct selection from multiple-choices.
they should prevent learning algorithms from exploiting shortcuts such that partial information is sufficient for performing well on the Visual QA task.