Recent work (Larsen et al., 2015; also considers combining autoencoders or variational autoencoders with GAN to demonstrate superior performance on image generation.
far, we can compute the loss from two paths of the encoder.