We showed that this difference can be bridged to some extent by a binary feature relating to idiomatic word usage, and that the difference vanishes when testing outside of the annotated corpus.
ideally, we would like our classifiers to learn only from robust features: consider only features that appear at least k times in the training data (rarefeature pruning).