Finally, we can derive the batch gradients for where I + w denotes the set of positive contexts for w, I + c denotes the set of positive words for c and  In the following, we show that AllVec can achieve the same time complexity with negative sampling based SGD methods.
another line of research is the count-based embedding, such as GloVe (Pennington et al., 2014).