∀i, GRU encodes the sequential information and the dependency among words until position i in u into the i-th hidden state.
the empirical results are consistent with our theoretical results: SCN is faster than SAN.