Typically, word usage statistics used to create a VSM form a sparse matrix with many columns, too unwieldy to be practical.
most models use some form of dimensionality reduction to compress the full matrix.