We applied the stochastic gradient descent (SGD) (Robbins and Monro, 1985) algorithm with mini-batch for optimization.
we used one layer of bidirectional LSTM for encoder and another uni-directional LSTM for decoder, with the size of LSTM hidden state set as 256 in both the encoder and decoder.