For learning word embedding, the training objective of continuous Skip-gram model (Mikolov et al., 2013b) is to predict its context.
the cooccurrence information can be effectively used to describe a word, and each component of word embedding might have a semantic or grammatical interpretation.