Experimental results using manually annotated datasets for lexical paraphrase showed that the proposed method outperformed bilingual pivoting and distributional similarity in terms of metrics such as MRR, MAP, coverage, and Spearman's correlation.
in this study, we conducted the evaluation by applying Pearson's correlation coefficient with a five-step manual evaluation using five datasets constructed by SemEval (Agirre et al., 2012(Agirre et al., , 2013(Agirre et al., , 2014(Agirre et al., , 2015(Agirre et al., , 2016.