Second, relevance judgments in nearly all newswire test collections are annotations on documents, not on individual sentences or passages.
given a query, we only know what documents are relevant, not spans within those documents.