Similarly, reset gate allows the model to drop information that is irrelevant in future.
a GRU network successively reads the input token t i , as well as the previous hidden state h i−1 , and generate the new memory content c i and hidden unit h i .