To concretize the intuitions developed with the help of the above examples, we first collect human judgments.
we take questions from existing datasets for document QA, knowledge base QA and visual QA and add systematic noise to these questions.