Note that If we choose W = U Σ, we exactly obtain w 1 , w 2 = s(w 1 , w 2 ), since W W = XX in this case.
the cosine similarity of the embeddings w 1 , w 2 coincides with the intuitive similarity s(w 1 , w 2 ).