It is possible that with a larger dataset, LSTM might perform comparable to or better than GRU.
our experiments with reducing the hidden layer size of LSTM-document model to control for the number of trainable parameters did not produce any significant improvements.