Both implement the memory with a Neural Turing Machine (Graves et al., 2014), in which the reading and writing operations are expected to erase translated contents and highlight untranslated contents.
their models lack an explicit objective to guide such intuition, which is one of the key ingredients for the success in this work.