While powerful, LSTM language models usually do not explicitly model many commonly-accepted linguistic phenomena.
standard models lack linguistically informed inductive biases, potentially limiting their accuracy, particularly in lowdata scenarios (Adams et al., 2017;Koehn and Knowles, 2017).