Together with the SPADE, researchers objectively compare performances of their methods measured by ALIR and ALIP with those of others .
aLIR evaluates how gold-alignments can be replicated by automatic alignments and aLIP measures how automatic alignments overlap with alignments that at least an annotator aligned as: aLIR aLIP Human 90.65 88.21 (arase and Tsujii, 2017) 83.64 78.91 Table 2: Benchmarks of aLIR and aLIP on the SPaDE where Ha is a set of automatic alignments, while G and G are the ones that two of annotators produce, respectively.