At top level, this is defined as the previous RNN.
the x(j) and x o (j) vectors, in addition to the feature vectors described as above now contain also the final states of another recurrent neural network.