The deep encoder consists of multiple layers, where the hidden states in layer − 1 are the inputs to the hidden states at the next layer .
where is the hidden state of the 'th layer RNN encoder for the i'th source sentence word.