Thus, perplexity ceases to be a measure of language modeling ability and assumes the role of a proxy for the out-of-vocabulary rate.
perplexity is a common intrinsic evaluation metric for generation models.