Based on depicting heatmaps of all heads for a few sentences, we choose the head that corresponds well to the relevant relation between source and target to derive the opponent attention 1 .
let α c denote the conventional encoder-decoder attention weights of the head which is used for deriving the opponent attention: where q and k are from the head same to that of α c .