However, this corpus is limited by being relatively small, only containing approximately 45,000 sentences, which we found to be insufficient to effectively train lattice language models.
5 we instead used the Billion Word Corpus (Chelba et al., 2014).