The CoNLL NER shared tasks (Tjong Kim Sang, 2002;Tjong Kim Sang and De Meulder, 2003)  One challenge for NER research is establishing an appropriate evaluation metric (Nadeau and Sekine, 2007).
entities may be correctly delimited but mis-classified, or entity boundaries may be mismatched.