Metadata for manual annotations includes amongst other information annotator ids 7 , details of manual curation as well as applied annotation guidelines.
in an adjudication step all three annotators then decided on the annotation, and remaining hard cases were discussed in the project context and documented separately.