From the perspective of generative model, we can also consider that words in a dialogue are generated by the mixture model of latent states, a global/background topic, and a dialogue specific topic.
there are three kinds of units in the hidden layer of our proposed model, which are displayed in Figure 1. h φ is a softmax unit, which indicates the latent state for a utterance.