However, due to increasing computational power and corpus sizes, language modeling today presents a different set of challenges than it did 20 years ago.
modeling crossdomain effects has become increasingly more important (Klakow, 2000;Moore and Lewis, 2010), and deployed systems must frequently process data that is out-of-domain from the standpoint of the language model.