These results also indicate that decreasing the number of words to be arranged does not guarantee higher agreement, and being presented with a semantically clusterable bigger set of words (like the ones produced in Phase 1) may be preferable to imposing an arbitrary size limit on the classes.
of the difficulty of some verb sets, the inter-annotator agreement scores for some classes show low positive correlation.