Harris articulated the expectation that words with similar meanings would be used in similar contexts (Harris, 1968), and recent empirical work involving large corpora has borne this out.
by associating each word with a distribution over the words observed in its context, we can distinguish synonyms from non-synonyms with fair reliability.