Each example consists of an input (source) sequence The encoder's representations are passed into an LSTM decoder using a bilinear attention mechanism .
at each time step t the decoder computes an attention distribution over source sequence hidden states as α j ∝ e h j Wαh t whereh t is the decoder's current hidden state.