To increase the modeling ability of (1), we may resort to more complex likelihood p θ (D|z), such as using deep neural networks to relate the latent z to the observation x i , instead of the simple softmax function in (2).
as indicated in , employing expressive nonlinear decoders likely destroy the distance-keeping property, which is essential to yield good hashing codes.