Similar results are also obtained for word embedings by GloVe and word2vec.
the first singular vector can be taken as the direction associated with this relation, while the other components are like random noise, in line with our model.