With NER, the spans are short and the task is less subjective than PICO or ARG, hence its higher F1 scores.
existing methods for aggregating sequence labels cannot model dependencies between the annotators' labels (Rodrigues et al., 2014;Nguyen et al., 2017) and hence do not account for their effect on annotator noise and bias.