Then word vectors are obtained by lowrank SVD on this matrix, or a related matrix with term reweightings.
the PMI matrix is found to be closely approximated by a low rank matrix: there exist word vectors in say 300 dimensions, which is much smaller than the number of words in the dictionary, such that where ≈ should be interpreted loosely.