In a random partition with k parts (clusters), for each word in a pair the probability for the other word of being in the same cluster is 1/k.
the resulting word vectors will be similar for words that appear in similar contexts.