Moreover, supervised approaches tend to be such that they can disambiguate only those words for which they have seen sufficient training examples to cover all senses.
we therefore find the mapping between elements of the two pairs that gives the lowest total distance, and halve it: with this method we observe a Krippendorff's α of 0.777; this is only slightly below the 0.8 threshold recommended by Krippendorff, and far higher than what has been reported in other sense annotation studies Jurgens and Klapaftis, 2013).