In the following two variants, we provide GRU with explicit subtraction operations, which are inspired by the well known phenomenon that minus operation can be applied to the semantics of word embeddings (Mikolov et al., 2013).
2 we subtract the semantics being translated from the untranslated FUTURE contents at each decoding step.