To predict sequences on unannotated text when trained on crowd labels, we consider two broad approaches: (1) directly train the model on all individual crowd annotations; and (2) induce consensus labels via Task 1 and train on them.
due to the technical difficulty of the joint approach with CRFs, they resorted to strong modeling assumptions.