While in principle it would be possible to produce the NNSE models directly on the co-occurrence data, here we chose to do this by using the SVD left-singular vectors as a stand-in for the full data.
this is our input representation matrix X ∈ m×n with m = 35560 words and n = 2000 input dimensions.