We wish to normalized to formal language, which is generally better processed by NLP tools.
for the phrase model, we use the English NIST dataset composed of 8M sentences in English from the news domain to build a 5-gram Kneser-Ney smoothed language model.