The Fleiss' kappa statistic (Fleiss, 1971) for this task was κ = 0.58, indicating a level of inter-annotator agreement very close to 'substantial'.
all workers agreed on 36.5% of the terms and at least 4 agreed on 69.9% of the terms.