Since the oracle score for CCGbank is less than 95%, it would not be a fair comparison to use the complete test set.
there are a number of sentences which are correct, or almost correct, according to EVALB after the conversion, and we are able to use those for a fair comparison.