We use the output of the language model, cross-entropy, as the reward.
given a sentence y t , the cross-entropy based reward for the k th word is calculated as We maximize the reward of real-world text and minimize the reward of generated text to train the discriminator.