Compared with GRU, MGU contains less trainable parameters, consumes less training time, and achieves similar performance.
in this paper, to better carry out our proposed "the lower the simpler" strategy, we propose Scalar Gated Unit (SGU), which is an even more simplified variant of GRU: Hidden State: By comparing the formulation of SGU with that of GRU, it is easy to see that both the update gate z t and the reset gate r t change from the vectors in GRU to the scalars in SGU.