A rigorous approach involves setting up a hypothesis testing scenario using the performance of the systems on query documents.
often the hypothesis testing approach needs to send a large number of document queries to the systems, which can be problematic.