Suppose we were unsure whether a word token x was an instance of w 1 or of w 2 .
it would be reasonable to express the probabilities of context words around this token in terms of the probabilities for w 1 and w 2 , assuming complete uncertainty between them: we could represent x with a vector, based on these probabilities, having the components: Which is exactly the vector averaging approach to semantic composition.