This work provides a theoretical justification for the presence of additive compositionality in word vectors learned using the Skip-Gram model.
importantly, this statement requires no assumptions on the distribution P (X, Y ).