While our KL-control models achieved higher qualitative ratings than the other offline RL algorithms, none of the RL models received higher qualitative ratings than the VHRED-EI Model (Table 4).
we reward semantic similarity between the user's input and the bot's response, to encourage the bot to stay on topic and produce reasonable answers.