Large-scale automatically-generated cloze tests (Hermann et al., 2015;Hill et al., 2016;Onishi et al., 2016) lead to significant research advancements.
we can also further verify the strengths and weaknesses of the 1B-LM by studying the performance of models and human on different question categories.