Nevertheless, DSG yields robust results on different scale of training data, which suggests that our model provides an effective solution to learn embeddings with exploiting the structure in context, while not severely suffered from the data sparsity problem.
among all SG models, DSG produces the best performance when trained on either the large or the small corpus.