However, we may not want to solely rely on only a few most important words.
to produce the initial hidden state of the decoder, we take a weighted average of the attention vector t and the mean of encoder hidden states: where λ determines the contribution from each vector.