5 Adding Context to NMT Now that we have several methods to incorporate global context regarding a single word, it is necessary to incorporate this context with NMT.
we propose two methods to either Gate or Concatenate a context vector c t with the Lookup embedding M e • 1(x t ) to form a context-aware word embedding before feeding it into the encoder as shown in Fig.