The intuition behind equation 8is that each pass in an upper bGRU layer provides more global information than a lower one and updates the states of each word time step to redeem correlations between distant words with the help of sentence-level information in the opposite direction of lower bGRU layer.
we stack two layers of the bGRU and treat them as a pair of short-term and long-term meanings.