Layers optionally take set of named arguments Layer definitions For each layer we have a corresponding layer definition based on the hidden states of the previous layer and any additional arguments.
each layer takes T hidden states h i 1 , ..., h i T , which in matrix form are H i ∈ R T ×d i , and produces a new set of hidden states h i+1 1 , ..., h i+1 T or H i+1 .