The distribution of a word over these soft clusters assignments was added as features to their classifier.
features based on distributional representations (e.g., raw co-occurrence frequencies) can be computed for every word, given that it occurs in some unlabelled corpus.