Results reveal superior variants of metrics distinct from previously best recommendations.
in MT, recent work has identified the suitability of Williams significance test (Williams, 1959) for evaluation of automatic MT metrics Graham, 2015), and, for similar reasons, Williams test is suited to significance testing differences in performance of competing summarization metrics which we detail further below.