This could be because their method is very aggressive in dealing with the history (as explained later in the Experiments section).
our method has a better way of handling history (by passing context vectors through an LSTM recurrent network) which gives us the flexibility to forget/retain some portions of the history and at the same time produce diverse context vectors at successive time steps.