Formally, given is a new dense representation of w ij which encodes also the information of the whole sentence.
siamese neural networks (Bromley et al., 1993) are well suited to this task because they are specifically designed to compute the similarity between two instances.