Moreover, the statistics only need to be computed once and can be re-used for training many different smaller-corpus RNNLMs.
in the table, the numbers in the column headings indicate the token count of the sequential corpus used to train the regularized methods.