The reward function helps achieve two of our aforementioned goals: • Maximize task success rate for the user: The reward function encourages the classifier to learn the dialog scenarios in which the model M might fail and choose a human agent instead.
the classifier helps to avoid sending an incorrect response to the user from the model.