One way to handle this problem is to build a language model of content tokens and retain only the maximum likelihood token sequence.
second, no negative information was used during pattern ranking in this experiment.