Since we find that the original contextual representations are important in reflecting the semantics at a more global level, we also introduce different levels of gating mechanism to incorporate the projected representations m(•, •) with the original contextual representations.
the final fused representations of passage and question can be formulated as: where g (•, •) is a gating function.