The pre-trained PCNN also achieves a significant improvement, and after further denoising by RL 2 , CNN+RL 2 finally obtain 57.89% in F1, which is still 3% lower than the performance of our model.
we consider that starting the model with a small but clean dataset might be a choice for noise reduction.