Since this depends solely on the n-gram LM, the true conditional probability under Markov assumption is not modeled and, therefore, context dependency beyond the window of (n − 1) is ignored.
attempting to utilize a higher amount of context can lower the probability of some tokens resulting in poor scores.