Success is usually measured in terms of correlation with human similarity judgments.
evaluating measures of phrase-level similarity directly against human judgments of similarity ignores the problem that it is not always possible to determine meaning in a compositional manner.