Their distributions should be more informative than the so-called "lexical weighting" models, and less sparse than relative frequency estimates, though potentially not as effective for truly non-compositional units.
we explore the inclusion of all such information.