The variational posterior is a factorized Gaussian distribution where the mean and the diagonal variance are predicted from the target utterance and the context as follows: where A known problem of a VAE that incorporates an autoregressive RNN decoder is the degeneracy that ignores the latent variable z.
the KL divergence term in Eq.