In a simple generator, the probability that the t th word is selected can be assumed to be conditionally independent from other selections given the input x.
the joint probability p(z|x) factors according to The component distributions p(z t |x) can be modeled using a shared bi-directional recurrent neural network.