By default, the hidden states of each word are hierarchically calculated by attending to all words in the sentence, which assembles global information.
several studies pointed out that taking all signals into account may lead to overlooking neighboring information (e.g.