The attention weights should better guide the focus of the model onto important context words of the sentence.
context words that are closer to entity representation mix should have better chances to be clue words.