Unlike a basic memory network (Weston et al., 2014), its addressing stage is based on the key memory while the reading stage uses the value memory, which gives greater flexibility to encode prior knowledge via functionality separation.
4 shows the attention heatmap generated for a test question "who did location surrender to in number " (where "location" and " number " are entity types which replace the topic entity mention "France" and the constraint entity mention "ww2", respectively in the original question).