Prior work has shown that the language statistic information is important for text normalization Li and Yarowsky, 2008;Kaji and Kitsuregawa, 2014).
we extract language model features by using word-based language model learned from a large quantity of standard texts.