Intuitively, in KB-QA, masking previously-addressed keys from the query could benefit latter inference, since the model will be able to focus on the next hop, e.g., the movie Taken.
we take into account the query and addressed memories at the t-th hop when updating the query q t+1 for the next hop: where ⊕ denotes the concatenation of vectors.