Compared to KN, the 5-gram LSTM can generalize to unseen ngrams thanks to its embedding layer and recurrent connections.
it cannot discover longdistance dependency patterns that span more than five words.