Additionally, it would be difficult, if possible, to reliably calculate IAA without coded alignments between the new and original sentences.
we look at two alternate measures: the percent of sentences to which different annotators made the same correction(s) and the sTER between two annotators' corrections, reported in Table 4.