Recently, Levy and Goldberg (2014a) showed that linear linguistic regularities first observed with word2vec extend to other embedding methods.
explicit representations of words in terms of cooccurrence counts can be used to solve analogies in the same way.