It is consistent with our motivation that the MI-regularized objective can alleviate the posterior collapse to improve VAEs' capability of generating fluent and diverse sentences with the effective use of the latent variable.
laggingVAE treats the MI as a stopping criterion for training the encoder RNN at the beginning of optimization.