Rather, the systems should be evaluated based on their ability to rank the set of phrases in the same order as the ranking given by the average human annotations scores for each dimension.
we calculate the Spearman Rank correlation between scores given by the automated systems and the human judges our final score for each system.