This considerably reduces the need for expert involvement compared to expert labeling, while still maintaining relatively high annotation quality.
our approach compares favorably to other hybrid setups in which a similar partition of tasks is completed by experts.