The test sets were created automatically from words contained in at least one of the systems' knowledge bases, with the proviso that the strings corresponding to the 59 rule types we extracted from the Penn Treebank reflected the frequency bias of these rule types, as far as possible.
we wanted to ensure that strings corresponding to a rule type that was (approximately) twice as frequent as some other rule type occurred (approximately) twice as often in the test sets.