We show that while the best practices for setting skipgram hyperparameters typically yield good results on intrinsic tasks, success on extrinsic tasks requires more careful thought.
we suggest that picking the optimal dimensionality and context type are critical for obtaining the best accuracy on extrinsic tasks and are typically task-specific.