Hence, we extract the context word x m with the maximum attention weight (Line 15-20) that will be exploited as attention supervision information to refine the model training.
we adopt two strategies to deal with x m according to different prediction results on x : if the prediction is correct, we wish to continue focusing on x m and add it into s a (x) (Lines 16-17); otherwise, we expect to decrease the attention weight of x m and thus include it into s m (x) (Lines 18-19).