Since our decoder model p(x| z) is a sophisticated rnnlm, simply sampling from the directed 100% word keep 75% word keep " no , " he said .
by breaking the model structure down into a series of next-step predictions, the rnnlm does not expose an interpretable representation of global features like topic or of high-level syntactic properties.