Compared with the normal word ngram model, the novel MI-Ngram model also incorporates the long distance context dependency by computing the mutual information of the distance dependent word pairs.
the MI-Ngram model incorporates the word occurrences beyond the scope of the normal ngram model.