We first want to explore the following idea: If a given annotator annotates most items with 0, then we might want to assign less significance to that choice for any particular item.
4 if an annotator appears to be biased towards a particular category, then we might want to try to correct for this bias during aggregation.