only for single annotators might be misleading, because specific annotators vary in the difficulty of examples they produce.
running a model on a new annotator that produces easy examples will not result in decreased performance.