It is furthermore argued that the asymmetric nature of KL-divergence makes it a natural choice for modeling hypernymy.
it is proposed that the word embeddings could be improved by imposing that words that are in a hypernym relation have a low KL-divergence, allowing for a natural way to combine corpus statistics with available taxonomies.