Intuitively, such a memory should be able to update itself dynamically by accounting not only for the factual embeddings but also for the current context of the generated sequence of words.
for example, American musician and pianist is generalized as American musician, since musician is a hypernym of pianist.