To alleviate this problem, we propose a simple heuristic that encourages the stochasticity of the encoder.
we penalize, for every data point, a KL term between the predicted posterior q(z|x) = N (µ post , diag σ 2 post ) and a Gaussian with covariance I centered at the predicted mean, i.e., N (µ post , I).