The vector space representations which serve as a basis for computing similarity can in principle be computed from any arbitrary corpus, given that it is large enough.
this need not be the same corpus as the one on which we observe predicate-headword co-occurrences.