We present here a general-purpose addition to the standard seq2seq framework that aims to simultaneously tackle all of the above issues.
we propose Scratchpad, a novel write mechanism that allows the decoder to keep notes on its past actions (i.e., generation, attention, copying) by directly modifying encoder states.