Therefore, a forgetting mechanism to "forget" less critical historical information, as is employed in LSTM (controlled by the forget gate f t ), becomes necessary.
in HRL, two independent signals, h LST M  The final representation h HRL T is obtained by the mean pooling of the two "sub" hidden states: h HRL T is then used for higher level tasks such as predicting the sequence label.