In the decoder, we usually use gated recurrent unit (GRU) Chung et al., 2014).
at each time-step t, the softalignment mechanism first computes the relevance weight e tj which determines the contribution of annotation vector h j to the t-th target word.