To overcome the latent variable vanishing problem in CVAE, we use the heuristic method (Bowman et al., 2016) to encode the meaningful information in z.
we multiply the first KL term in Eq.12 by a scalar, which starts at 0 and linearly increases to 1 over the first 10,000 batches.