Equation 1 relates orthogonality of vector differences to their dot product being zero, which corresponds to the fact the cosine of 90 • is zero.
we can use the cosine as a quantification of how close to orthogonal the vector differences are and then relate that to performance on the word-analogy dataset distributed with the word2vec toolkit.