The annotators were given the entries as well as the reference sample annotated by the lexicographer and a test sample of 50 concordances for annotation.
the final multiple 50-concordance sample went through one more additional procedure, the adjudication: first, the lexicographer compared the three annotations and eliminated evident errors.