Specifically, a model's retrieval quality can be examined by checking across a range of individual document pairs, namely, how likely a model can assign a higher score for a more relevant document.
it is possible for us to compare different models over the same set of complete judgments, removing the issue of different initial runs.