The majority were criticisms of the test collection paradigm itself and are not pertinent here.
the source-document principle (i.e., the use of queries created from documents in the collection) attracted particular criticisms.