It first creates step-specific context and query encodings via cell-specific bidirectional LSTMs: Then, we use bidirectional attention (Seo et al., 2017) to emulate a hop of reasoning by focusing on relevant aspects of the context.
we first compute context-to-query attention: 3 are trainable parameters, and is elementwise multiplication.