Running a language model on a recurrent neural network (RNN) (Mikolov et al., 2010) is, of course, a reasonable choice because of the good prediction performance for closed-vocabulary task.
a neural network LM usually does not include a generative process, so it is difficult to apply to unsupervised training of a language model or lexicon acquisition from speech signals.