4), we observe non-significant improvements in ROUGE compared to the baseline.
the attention mechanism  Figure 2: Our 2-decoder summarization model with a pointer decoder and a closed-book decoder, both sharing a single encoder (this is during training; next, at inference time, we only employ the memory-enhanced encoder and the pointer decoder).