The main advantage of having such a distributed representation over word classes is that it can capture various dimensions of both semantic and syntactic information in a vector where each dimension corresponds to a latent feature of the word.
a distributed representation is compact, less susceptible to data sparsity, and can implicitly represent an exponential number of word clusters.