In variational Seq2Seq, however, the attention mechanism unfortunately serves as a "bypassing" mechanism.
the variational latent space does not need to learn much, as long as the attention mechanism itself is powerful enough to capture source information.