Our results suggest that regularized softmax models perform competitively as long as we are only interested in low test time complexity.
the ability of statistical language models (LMs) to estimate the probability of a word given a context of preceding words, plays an important role in many NLP tasks, such as speech recognition and machine translation.