By using negative sampling, the training time spent on summing up the whole vocabulary in Formula (2) is greatly reduced so that it becomes linear with the number of the negative samples.
we can calculate the gradient of G(v I ) as below, In the back-propagation process, the weights in the matrices M and M are updated.