The hidden attention vector a h t,i is integrated with the output attention by a weight λ a ∈ [0, 1]: The output context vector is computed as: To update the output vector s t in Equation 5, we develop a different method from that of the hidden attentions.
we use a weighted combination of the context vectors and the original outputs with λ c ∈ [0, 1].