Other work has considered the empirical effects of some of the more arbitrary-seeming algorithmic choices (Levy et al., 2015).
to determine whether observed properties are due to SGNS specifically or to embeddings in general, we compare SGNS-trained vectors to vectors trained by the GloVe algorithm (Pennington et al., 2014).