The best model is the one integrating the attentive GRU encoder, which is significantly superior to all baseline models (p < 0.05), achieves an F-score of 88.49%, To confirm the effectiveness of the language modeling of POS sequence, we also try to exclude the GRU language model from our best model.
directly using the labels made by the crowd as ground-truth for training and testing may lead to inaccurate performance due to the reliability issue.