These models can down-weight the annotations of workers who often disagree with others and up-weight the annotations of workers who often agree with others.
most crowdsourcing models extend the item-response model of Dawid and Skene (1979).