Unlike the handcrafted gold standard, the automatically generated tests were produced randomly by a machine with no knowledge of test design so we would expect automatic gaps to be often inserted in inconvenient locations within the text, yielding lower quality tests.
entropy is shown to provide insights into the expected difficulty of the question and correlate directly with the target proficiency level of the exercises.