This may underestimate the difculty of the Brown corpus by including sentences from the same documents in training and test sets.
because the word pair feature is the most speci c in the model, it is likely to be the most corpusspeci c. The vocabularies used in corpora vary, as do the word frequencies.