During our experiments, we measure the endto-end performance of the entire QA pipeline in terms of exact matches.
we count the fraction of questions for which the provided answer matches one of the ground truth answers exactly.