It also shows that careful initialization of model parameters can bring further improvements.
we also find that words that are close to the centroid are not necessarily representative of what linguists consider to be prototypical.