Guided by the golden restated query z, in training, we find outz * by computing the reward of each candidate.
in inference, where there is no golden restate query, we can only obtainz * from F. Specially, for the v-th span in the followup query, we find u * = arg max u F u,v .