(2017) on this dataset, the results are encouraging given the simplicity of the Averaging RNN-LM.
we should note that none of these models perform at the same level of the state-ofthe-art models such as those of  and Takase et al.