word2vec (Mikolov et al., 2013) -perhaps the most popular model of word meaning representation, implicitly factorizes the values of the wordcontext PMI matrix.
the same analysis is repeated in the shuffled condition, see Fig.