): In addition to the word's frequency, in fact, we believe that the contextual diversity plays a critical role of affecting the quality of word embedding.
we propose a score function based on the conditional entropy (information content) from the information theory.