In this section, we provide theoretical support for the usefulness of the features learned even when the Skip-Gram model is misspecified.
we state that the best candidate for having the same meaning as the set of context words C is the word We refer to any vector that minimizes (4) as a paraphrase of the set of words C. There are two natural concerns with (4).