The learning algorithm is actually fast enough to do this automatically after each labeling action.
we found such a dynamically changing interface to be frustrating for users (e.g., words they wanted to label would move or disappear).