This paper makes the following contributions: • It revisits the attention model from the point view of reordering ( §2), and propose a supervised attention for NMT that is supervised by statistical alignment models ( §3).
the attention based NMT might not deliver satisfying alignments, as reported in (Cheng et al., 2016), compared to conventional alignment models.