This work provides a theoretical justification for the presence of additive compositionality in word vectors learned using the Skip-Gram model.
it shows that additive compositionality holds in an even stricter sense (small distance rather than small angle) under certain assumptions on the process generating the corpus.