(2015) proposed an attention mechanism.
when generating the i-th target word, the attention factor of the j-th source word (and its neighbors, precisely) is measured by the relevance between the current hidden state of the decoder, denoted by s t−1 , and the hidden state of the encoder at the j-th word h j .