There are various approaches relying on n-gram corpora, such as the Google n-gram corpus.
in summary, our results indicate that one can train high-quality embedding models with ngrams if some (mild) prerequisites hold.