The VHRED with the bag-of-words loss (bow) achieves the highest KL divergence, however, at the cost of high NLL values.
the variational lower-bound minimizes the minimum description length, to which the bow loss works in an opposite direction by forcing latent variables to encode bag-of-words representation of utterances.