2018propose a RNN-based model, RNMT+, which is based on stacked LSTMs and incorporates some components from Transformer such as layer normalization and multi-head attention.
our model is based on Transformer and incorporates RNN into Transformer.