However, this is an unfair comparison: the monolingual model's high perplexity is dominated by low probabilities assigned to rare tokens in the opposite-language data that it did not see.
perplexity ceases to be a measure of language modeling ability and assumes the role of a proxy for the out-of-vocabulary rate.