The performance tends to improve as the RNN or Grid layers get deeper with residual connections.
the two models with eight layers and residual connections achieved considerable improvements of approximately 1.0 point according to the F-measure compared to models without residual connections.