This paper introduces a framework and model to combine such diverse information from crowd workers, to measure and model individual annotator errors, and to form consensus final predictions.
existing crowdsourcing models cannot simultaneously model multiple kinds of information.