For the first term in (3), we should in principle estimate the influence of µ i in (2) on q θ (x|z) by averaging over the entire (uniform) noise distribution.
our work focuses on learning discrete (binary) representations for text documents.