Gate Mechanism We also propose a gate mechanism to dynamically control the amount of information flow from the forward and backward contexts.
we apply a feed-forward gating layer upon − → H history as well as − → H f uture to enrich the nonlinear expressiveness of our model: where denotes element-wise multiplication.