the Transformer (Vaswani et al., 2017) replace RNNs with parallelizable components in order to reduce the time complexity of the training.
the drawback is that the model needs to explicitly determine the target sentence length and reorder the state sequence before it starts generating the output.