Following the recent line of work on generative dialog systems (Vinyals and Le, 2015), we treat the problem of response generation given the dialog history as a conditional language modeling problem.
we want to learn a conditional probability distribution P θ (U t |U 1:t−1 ) where U t is the next response given dialog history U 1:t−1 .