Dataset: To make a fair comparison with the state-of-the-art methods, we employ a publicly available dataset, which is used in (Huang et al., 2012), to train word embeddings in our experiments.
this training corpus is a snapshot of Wikipedia at April, 2010(Shaoul, 2010, which contains about 990 million tokens.