In order to reduce noise in training data, most natural language crowdsourcing annotation tasks gather redundant labels and aggregate them into an integrated label, which is provided to the classifier.
aggregation discards potentially useful information from linguistically ambiguous instances.