In language modeling, perplexity or cross-entropy is widely accepted as a de facto standard for intrinsic evaluation.
distributed word representations include the additive (or compositional) property of the vectors, which cannot be assessed by perplexity.