(Pennington et al., 2014) further utilizes matrix factorization on word affinity matrix to learn word representations.
these models merely arrange only one vector for each word, regardless of the fact that many words have multiple senses.