This therefore includes only mentions identified as being in the ACE semantic categories by both the key and the system response.
these scores cannot be directly compared against coreference scores involving all noun phrases.