In this paper, we propose to alternatively use Silver Standard, i.e., a high-quality automatic annotated data, to train the crowd workers.
we introduce a self-training strategy for crowd-sourcing, where the workers are first trained with simpler examples (which we assume to be less noisy) and then gradually presented with more difficult ones.