Each item has sense labels from up to twenty-five different annotators, collected through crowdsourcing.
we conclude that a modelbased label derived from many Turkers is preferable to a label from a single trained annotator.