In practice, given one partial response and its query, its future reward is unknown without results from a large-width beam search as references.
we propose Prospective Performance Network (PPN) as a future reward estimator.