M 2 was assessed by comparing its output against that of the official Helping Our Own (HOO) scorer (Dale and Kilgarriff, 2011), itself based on the GNU wdiff utility.
despite these many proposed metrics, no prior work has attempted to answer these questions by comparing them to human judgments.