input feeding), to predict the next word, until the <eos> symbol is generated .
the transformer architecture works by relying on a self-attention (intra-attention) mechanism, removing all the recurrent operations that are found in the previous approach.the attention mechanism is repurposed to compute the latent space representation of both the encoder and the decoder sides.