These methods were applied to not-so-large scale experiments (55 million (M) words for training their BNLMs) (Arsoy et al., 2013).
our method is applied to SMT and can be used to improve a BNLM created from 746 M words by using a CSLM trained from 42 M words.