Hence, we introduce attention mechanism to extract such words that are important to the meaning of the sentence and aggregate the representation of those informative words to form a sentence vector.
w it with t ∈ [1, T ] represents the words in the ith sentence.