It is heavily task dependent, in that a representation that is suitable for machine translation may not be appropriate for textual inference tasks, and one that is appropriate for IR may not be ideal for paraphrase detection.
this aspect of semantic model evaluation ideally should take the form of application-oriented testing.