Perplexity is a common intrinsic evaluation metric for generation models.
3 for comparing monolingual and bilingual models, we found perplexity to be unhelpful, owing largely to its vocabulary-dependent definition.