The probability estimates of those models are smooth functions of these embeddings, and a small change in the features results in a small change in the probability estimates (Bengio et al., 2003).
neural language models can achieve better generalization for unseen n-grams.