In this paper we propose an alternative: we test models on their ability to answer naturally occurring yes/no questions.
questions that were authored by people who were not prompted to write particular kinds of questions, including even being required to write yes/no questions, and who did not know the answer to the question they were asking.