Since not all words contribute equally to the representation of the sentence, we introduce a word level attention mechanism which attempts to extract relevant words that contribute to the meaning of the sentence.
we learn a word level attention matrix W w as follows is the latent representation of the sentence i.