Each verb-noun tuple was matched with two verbs that are synonyms of the reference verb in some contexts but not in Table 7 Most-and least-accurately predicted items for the LDA P→A models using per-item Spearman's ρ pseudo-coefficients on the unseen data set, with gold and predicted rank values.
in addition to Mitchell and Lapata's ρ cat evaluation, we also perform an evaluation that computes the average correlation ρ ave between the system output and each individual annotator: 4.4.2 Models.