These issues led us to report token-level entity-identification F 1 score for this dataset.
if a named entity token was identified as such, we counted it as a correct prediction ignoring the named entity type.