Like LSTM (Hochreiter and Schmidhuber, 1997), GRU cells are also designed to capture long range dependencies, but have fewer parameters than LSTM cells.
our encoder uses six (6) recurrent layers of BiGRU cells, and generates hidden states H = (h 1 , .