We are able to identify label mistakes in about 5.38% test sentences, which is a significant ratio considering that the state-of-the-art test F 1 score is already around 93%.
we manually correct these label mistakes and form a cleaner test set.