Among which we chose the word2vec tool (Mikolov et al., 2013), 2 because of its efficiency and wide uses in nat-ural language processing.
we used the skipgram, which inputs each current word to a log-linear classifier with a continuous projection layer, and predicts its context words within a certain window.