While the focus of the presentation in the wordembedding literature is on the mathematical model and the objective being optimized, other factors affect the results as well.
embedding algorithms suggest some natural hyperparameters that can be tuned; many of which were already tuned to some extent by the algorithms' designers.