We compute a word-pair's entropy by considering it as a distribution over features, in a manner that is analogous to the feature entropy defined in (Turney, 2006).
in this study, we present a novel system for generating lexical analogies directly from a text corpus without relying on dictionaries or other semantic resources.