To get a clearer picture, we measured perplexity for only specific subsets of words in our test data: specifically, given target word w i , we measure perplexity of word w i+1 .
we analyze the perplexities when the inflected words of interest are in the most recent history, exploiting the recency bias of our LSTM-LM.