Then we evaluate the word distributions between the generated documentd Y i and the ground-truth document d Y i , and use such signal to optimize the model.
straight-forward loss design, e.g., KL-divergence or Wasserstein distance between the word distributions ofd Y i and d Y i is not differentiable w.r.t.