This may underestimate the difculty of the Brown corpus by including sentences from the same documents in training and test sets.
because of the variation within the Brown corpus, we felt that a single contiguous test section might not be representative.