However, the study of Weeds and Weir (2005) provides interesting insights into what makes a "good" distributional similarity measure in the contexts of semantic similarity prediction and language modeling.
weighting features by pointwise mutual information (Church and Hanks 1989) appears to be beneficial.