We found that standard training failed to learn informative latent actions for either DVAE or DVST because of the posterior collapse.
kL-annealing (Bowman et al., 2015) and bag-of-word loss  are used to force these two models learn meaningful representations.