The PMI-based weighting function is critical here since it helps to highlight the more surprising events in original word-context matrix.
more recently, (Levy and Goldberg, 2014) has showed that the objective function of SGNS is essentially seeking to minimize the difference between the models estimate and the log of cooccurrence count.