Typically, when deploying a question answering system, there is some cost associated with returning incorrect answers to a user.
once the set of query reformulations has been generated, each rewrite is formulated as a search engine query and sent to a search engine from which page summaries are collected and analyzed.