It is no wonder manual feedback shows excellent and stable performance if enough relevant documents are available, hence the challenge is how it keeps high performance with less amount of manual relevance judgment.
we restrict the manual judgment to the minimum amount, namely only a relevant document and a non-relevant document.