In a real application, we do not have access to true markables, so an evaluation on system markables (markables automatically detected by the system) reflects actual expected performance better.
(2002) and Ng and Cardie (2003) is that we do not use any human-labeled coreference pairs.