Since it is hard to evaluate the retrieval-stage, we evaluate the end-to-end response selection performance.
we first rewrite the contexts in the test set with CRN, and then retrieve 10 candidates with the rewritten context from the index 6 .