We showed that past work for CDEC have resorted to widely different evaluation approaches, making several implicit assumptions, which simplify the coreference task and lead to overlooking coreference mistakes.
as we showed, excluding singleton mentions from the evaluation does not seem justified.