While there have been works trying to incorporate human design into cloze question generation (Zweig and Burges, 2011;Paperno et al., 2016), due to the expensive labeling process, the MSR Sentence Completion Challenge created by this effort has 1, 040 questions and the LAM-BADA (Paperno et al., 2016) dataset has 10, 022 questions, limiting the possibility of developing powerful neural models on it.
of the small size, human-created questions are only used to compose development sets and test sets.