By default, the hidden states of each word are hierarchically calculated by attending to all words in the sentence, which assembles global information.
our hybrid model not only utilizes the local context but also exploits the global information.