For example, we examined the annotation used in (Meij et al., 2012) and found it to be extremely lenient, when compared to our own beliefs of what is an entity.
we believe evaluating performance on restricted entity types is the only fair way to compare different endto-end entity linking systems.