Following the recent line of work on generative dialog systems, we treat the problem of generating an appropriate response given a conversation history as a conditional language modeling problem.
we want to learn a conditional probability distribution P θ (y|x) where y is a reasonable response given the conversation history x.