It is therefore crucial that all annotations at a high level of interpretation are backed up by human annotation with more than one annotator.
annotations of citation function classification typically use only the untested annotation of a single human annotator as gold standard, who is typically the designer of a scheme (Spiegel-Rüsing, 1977;Weinstock, 1971;Nanba and Okumura, 1999;Garzone and Mercer, 2000).