The CVAE and Seq2seq model with the rhetorically controlled decoder should be trained jointly.
the overall loss L is a linear combination of the KL term L KL , the classification loss of the rhetoric predictor cross entropy (CE) L predictorCE , the generation loss of the rhetorical controlled decoder cross entropy L decoderCE , and the word type classifier (word type distribution predictor) cross entropy L word classifier : The technique of KL cost annealing can address the optimization challenges of vanishing latent variables in this encoder-decoder architecture.