In the seq2seq approach, the decoder network therefore only has to keep track of where it is in the output, and the content to generate can be transformed from the relevant parts in the source via the attention mechanism .
the full conditional probability follows from the product rule, as: We propose to implement target-side attention by augmenting the attention mechanism to include the part of the target sequence already generated, i.e., we include y [0:i−2] in the arguments to the attention function: Attention(h i−1 , y [0:i−2] , x).