We see in Table 4 from setup #5 experiments that training and testing on error-containing utterances led to a dramatic improvement in F 1score.
our results for experiments using setup #6 (where training data was filtered to contain errorful data but test data was fully preserved) are consistently worse than those of either setup #2 (where both train and test data was untouched) or setup #5 (where both train and test data were prefiltered).