This approach performs SVD on a term-term co-occurrence matrix, which has been shown to outperform traditional LSA models that use term-document cooccurrence information.
a given word w is initially represented by a vector v of all its co-occurring words in a small collocation context (a 5-word window), i.e., v = (v 1 , .