One possible explanation lies with the linguistic features with which we approached CoNLL: these are the same ones we originally developed for MUC-6.
because a typical entity extraction model can use tens or hundreds of thousands of features, it is not practical to displace every one of them.