This finding is consistent with previous work on simpler tensorbased models, which showed that applying some form of word sense disambiguation when composing word vectors can provide consistent improvements on end tasks such as sentence similarity and paraphrase detection .
for each word w i in a training example, a context vector c i is computed as the average of the generic vectors of all other words in the sentence.