We check that suggested phrases do not overlap with already translated source words by keeping track of the sum of attention in previous time steps for each source position.
the problem of global reordering is left entirely to the NMT model and we follow the attention when hypothesizing phrases.