This way, we could obtain insights into our building blocks, in addition to assessing the end-to-end performance.
we could assess the goodness of the question-to-query translation independently of the actual answer quality which may depend on particularities of the underlying datasets (e.g., slight mismatches between query terminology and the names in the data.)