Surprisingly, although Random Indexing takes into account more information than first-order word co-occurrence, it lowered overall performance substantially.
in Table 4, we only present results of using first-order word co-occurrence rather than Random Indexing.