For the first hidden layer, the computation proceeds similar to that described in Section 3.1.
for higher hidden layers i the input to the memory block is the hidden state and memory cell from the previous layer i − 1 instead of the input vector representation.