Because different order dependency N-gram models are trained separately, we use linear interpolation in calculating the test set perplexity.
we use the hand-out development set to tune the interpolation coefficients (weights) and to select the iteration times of different order models to minimize the development set perplexity.