Furthermore, the more target words are generated, the more time the self-attention in the decoder will take to model dependencies.
preserving the training efficiency of the Transformer on the one hand and accelerating its decoding on the other hand becomes a new and serious challenge.