The following points are worth noting from the results of Figure 7: (1) MUC and CEAF m are the least discriminative metrics when the system output includes extra mentions; (2) except for CEAF e , other metrics rank 3-10 as the worst output;(3) CEAF e recognizes both 2-0 and 3-0 as the worst outputs.
in these outputs the extra mentions are linked together and therefore no incorrect information is added to the correctly resolved entities; and (4) LEA is the only metric that recognizes error 2-0 is less harmful than 1-2 or 1-10.