The main reason for this is because the development set used to train the LM is relatively small, at only 1166 sentences.
as our goal in this paper is to perform error analysis on set of data which we already have parallel references (in this case, the development set), the generalization ability of the model is not necessarily fundamental to our task at hand.