The weights update rules of theses models use as inputs one or several of (i) a previous hidden state of a RNN network or higher level network and/or (ii) the current or previous inputs to the network.
the top curve compares a one-level model (language model) with a two-levels model (language model + meta-learner).