We use this attention a t i to generate the context vector c * t as a weighted sum of encoder hidden states: We further use the c * t vector to obtain a probability distribution over the words in the vocabulary as: , where W v and b v are model parameters.
during decoding, the probability of a word is P (qword).