Note that the X t is an attention vector generated based on the current state and the memory of the passage: (Shen et al., 2016).
the attention score a t,i on a memory vector where λ is set to 10 in our experiments and the projection matrices w 1 and w 2 map the memory vector and state into the same space, they are learned during training.