Their models are largely based on memory networks , originally developed for reasoning-focused machine reading comprehension tasks.
to memory networks, where each input sentence/word occupies a memory slot and is then accessed via attention independently, recent advances in machine reading suggest that processing inputs sequentially is beneficial to overall performance (Seo et al., 2017;Henaff et al., 2017).