Educators often use cloze tasks to evaluate learner vocabulary (though these generally use L2 context).
7 We compute three different features for each language model: a raw LM score, a sentencelength-normalized LM score, and the difference between the LM score with the correct answer in the sentence and the LM score with the candidate in its place.