The encoder then takes the word embedding v enc (w i ) and the hidden state h (2) i as the input to a uni-directional LSMT: is the hidden state corresponding to w i .
the encoder of our model is a three-layer LSTM network, where the first two layers are bi-directional.