• The FFN-based models, on the other hand, avoid this difficulty by feeding directly on the history.
competitor Models we compare gencNN to the following competitor models • 5-gram: We use SRI Language Modeling Toolkit (Stolcke and others, 2002) to train a 5-gram language model with modified Kneser-Ney smoothing; • FFN-LM: The neural language model based on feedfoward network (Vaswani et al., 2013).