What is crucial about this RNN, like the α j (i), is that it only summarizes the characters decoded so far independently of the previous attention weights.
the attention weights at time step i will have no influence from the attention weights at previous time steps, shown in Fig.