Formally, given is a new dense representation of w ij which encodes also the information of the whole sentence.
word Attention with Context Vector only certain words in a sentence express the semantics of a relation, therefore we need a strategy to automatically identify them during the training.