Context gates are non-linear gating units which can dynamically select the amount of context information in the decoding process.
at each decoding step, the context gate examines both the source and target contexts, and outputs a ratio between zero and one to determine the percentages of information to utilize from the two contexts.