We incorporate the target syntax p 2 into the generation process by modifying the inputs to the decoder.
a standard decoder LSTM receives two inputs at every time step: (1) the embedding w t−1 of the ground-truth previous word in s 2 , and (2) an attention-weighted average a t of the encoder's hidden states.