In our experiments we noticed frequent cases where the LM does not provide sufficient support to distinguish between true grammatical errors and simply unusual but grammatically correct expressions.
this 4 billion n-gram corpus should provide high-quality perplexity estimations.