Another result due to this difference is that the rewards with regard to ease of answering or information flow do not apply to this case, but the reward for semantic coherence does.
the reward of the agent is: where rw(c, r) is the reward with regard to the conversation c and its reference response r in the dataset.