Once the input sequence is encoded, seq2seq models generate a target sequence using a decoder.
the decoder is tasked with generating a target sequence of words from a target vocabulary V. words are generated sequentially by conditioning on the input representation x and on the previously generated words or history.