Since the size of English vocabulary W may be up to 10 6 scale, hierarchical softmax and negative sampling (Mikolov et al., 2013b) are applied during training to learn the model efficiently.
moreover, Chinese characters are more ambiguous than words.