In addition to reporting standard LM perplexity, we compute two measures of performance, which are intended to provide an intuitive picture of how well each model captures the nature of the information that is introduced by the human editors.
we compute Exact Match as the proportion of sentences for which the model produced the gold phrase (i.e.