The approach is analogous to the recently emerged LSTM (Graves et al., 2013;Zaremba and Sutskever, 2014;Xu et al., 2015) and gated neural network (Cho et al., 2014;Chung et al., 2015).
the transition function of the gated RNN used in this work is calculated as follows.