Both the generator and the discriminator are pre-trained for 10 epochs before adversarial learning.
for PG-BLEU and SeqGAN, before reinforcement learning or adversarial learning, we pre-train the sequence-to-sequence model for 10 epochs like DP-GAN.