PCA calculates r i,j by using the correlation coefficient, whereas the other approaches employ the inner product or cosine formula 2 (Manning et al., 2008) to derive the relationship between textual units.
the correlation coefficient is identical to the cosine formula if we normalize each unit with its mean: and are the mean-normalized vectors of u i and u j , respectively.