Stochastic Gradient Descent (SGD) with negative sampling is the most prevalent approach to learn word representations.
it is known that sampling methods are biased especially when the sampling distribution deviates from the true data distribution.