First, as a cognitive model, it relates the kinds of learning biases used in previous work to the wider literature on working memory.
finally, we find that, despite pre-training, the system may settle into an initial state where the phonological network simply embeds the characters and the utterance network learns a character LM.