sampling (k) 5 -# of iterations (T ) 5 20 # of threads 56 # of dimensions (D) 300 Table 3: Hyper-parameters in our experiments.
in particular, the original SGNS uses β(c i,j ) = 1 for all (i, j), and logistic loss function: GloVe uses a least squared loss function: Table 2 lists the factors of each configuration used differently in SGNS and GloVe.