In our opinion, research on the modeling of compositional phenomena within a distributional framework would substantially benefit from new evaluation frameworks.
we think of a lexical substitution or paraphrasing task along the lines of McCarthy and Navigli (2009), but specifically aimed at the assessment of compositional phenomena.