While it would be ideal if our chatbots could intelligently adapt their conversation style to a new user, in reality most baseline dialog models struggle to maintain topic coherence, even over a few utterances (for an analysis of this effect, see ).
we reward semantic similarity between the user's input and the bot's response, to encourage the bot to stay on topic and produce reasonable answers.