Standard dropout: PRUs achieve either the same or better performance than LSTMs.
the performance of PRUs improves with the increasing value of g. At g = 4, PRUs out-perform LSTMs by about 4 points on the PTB dataset and by about 3 points on the WT-2 dataset.