To account for the history, we treat successive context vectors as a sequence and use a modified LSTM cell to compute the new state at each time step.
we use the following set of equations to compute a diverse context at time t: where 8; l 5 is number of hidden units in the LSTM cell.