However, the expressive power of hierarchical RNN decoders makes the model still prone to ignore latent variables z conv and z utt t .
our second idea is to apply an utterance drop regularization to effectively regularize the hierarchical RNNs, in order to facilitate the use of latent variables.