It should be detrimental to keep tangential information, as illustrated by the example in Figure 1.
autoencoding systems need to introduce additional loss terms to augment the reconstruction loss (e.g.