Our approach is to modify the emission probabilities of states to be distributions over topics rather than distributions over words.
instead of generating words via a LM, we generate words from a topic model (TM), where each state maps to a mixture of topics.