Most current RNNLMs only use one single feature stream, i.e., surface words.
first, we employ a Kaldi speech recognizer (Povey et al., 2011) to decode each utterance using the trained AM and the 3-gram LM.