Recurrent neural networks (RNNs) (Elman, 1990) is commonly used to build block for seq2seq model.
our model employs the Long Short-Term Memory (LSTM) (Hochreiter and Schmidhuber, 1997) variant of RNN, which uses numbers of gates to address the problem of vanishing or exploding gradient when trained with back-propagation through time.