Furthermore, as the length of context increases, the ratio for the Kneser-Ney smoothed model becomes greater -a clear sign of over-parameterization.
the ratio for the neural network model changes very little even when the length of the context increases from 4 (2H) to 8 (3H-1OP).