During the training process, we used the same strategy to set the learning rate as what Word2Vec did.
we set the initial learning rate to 0.025 and diminished the value linearly along with the increasing number of training words.