It could be that the gains we obtained come simply from biasing the system against such rules.
the results in table 6 show that this is unlikely to be the case: features that just count context words help very little.