In recent years, the recurrent neural network based language models have defeated the conventional n-gram based techniques.
it is difficult for neural network architectures to use linguistic annotations.