The size of the sets allows using any MT evaluation measures to measure performance, and is thus a much more scalable solution than manual inspection, as is commonly done in challenge set approaches.
an automatic methodology has the side-effect of being noisier, and not necessarily selecting the most representative sentences for each phenomenon.