Finally, we found it useful to impose a form of vocabulary restriction on the cluster-based features.
for any feature that is predicated on a word form, we eliminate this feature if the word in question is not one of the top-N most frequent words in the corpus.