, c m has the same meaning as the single word c if for every other word w, Although this is an intuitively satisfying definition, we never expect it to hold exactly; instead, we replace exact equality with the minimization of KL-divergence.
we state that the best candidate for having the same meaning as the set of context words C is the word We refer to any vector that minimizes (4) as a paraphrase of the set of words C. There are two natural concerns with (4).