As decoding proceeds, the influence of the initial input on decoding (i.e., the source sentence representation) diminishes as additional previously-predicted words are encoded in the vector representations.
4 the first words to be predicted significantly determine the remainder of the sentence.