To examine whether the 2DLSTM reduces the need of attention, in the second set of experiments, we equip our model with a weighted sum of 2DLSTM states, t i , over j positions to dynamically select the most relevant information.
: In these equations, γ j,i is the normalized weight over source positions, s j,i is the 2DLSTM states and W and v are weight matrices.