(2014) greatly improved the initial sequence-tosequence architecture; rather than conditioning each target word on the final hidden unit of the encoder, each target word prediction is conditioned on a weighted average of all the encoder hidden units.
there have been several attempts to mitigate this discrepancy, mostly with a view to improving the quality of output translations (Alkhouli et al., 2016(Alkhouli et al., , 2018Chen et al., 2016;Liu et al., 2016) -though some work has focused specifically on alignment (Legrand et al., 2016;Zenkel et al., 2019).