The computation resembles other recurrent networks such as LSTM, GRU and RAN .
a forget gate f t controls the information flow (Equation 1) and the state vector c t is determined by adaptively averaging the previous state c t 1 and the current observation Wx t according to f t (Equation 2).