This change by itself yields 51.7 pairwise F1 (see BASE-TREE in Table 2), which is small overall, but reduces pairwise pronoun antecedent selection error from 51.3% to 42.5%.
to most recent research, our pairwise decisions are not made with a learned model which outputs a probability or confidence, but instead for each mention m i , we select an antecedent amongst m 1 , .