When we discard the infrequent words, we only narrow down the input vocabulary and do not change the output vocabulary.
the perplexity scores are still comparable with the scores in the above experiments.