Before drawing any conclusions from the data, we measured the interannotator agreement.
we had speculated that WSsim/USim data might have been slightly easier to annotate, given the lemmas processed: while VPS-GradeUp contains only Figure 2: The annotation form using Google Forms verb lemmas (29), WSsim contains 11 lemmas of various parts of speech (4 verbs: add, ask, order, and win, 5 nouns: argument, function, interest, investigator, and paper, and 2 adjectives: important and different).