Also, it should converge to zero at the end of the sentence.
we first introduce a recurrent attention mechanism with extra recurrent paths as an implicit distortion model to solve the reordering problem.