As we will see in our experiments (Section 5) the largest gains can be obtained with extremely coarse language models.
the largest coarse model we use in our best multipass decoder uses a 4-bit encoding and hence has only 16 distinct words (or at most 4096 trigrams).