The MI not only measures how accurate the output agrees with its input, but also whether a meaningful latent variable can be learned in the latent space.
the estimation and maximization of the MI in the high-dimensional space are difficult.