There is an obvious difference between the F1 scores achieved with all gold mentions and non-singleton gold mentions.
the room for improvement by better mention detection is not as enormous as suggested in (Lee et al., 2017).