The disagreement regularization serves as an auxiliary objective to guide the training of the related attention component.
in terms of training speed, we do not observe obvious decrease, which in turn demonstrates the advantage of our disagreement regularizations.