Significant improvements in both perplexity (PPL) and word error rate (WER) over backoff smoothing were reported after interpolating the neural network models with the baseline backoff models.
the neural network models rely on interpolation with ¢ -gram models, and use ¢ -gram models exclusively for low frequency words.