We devise the reward function r φ (X) according to the discriminator's output D φ (X) and the stationary distribution P s (X): Intuitively, this reward function encourages the generator to generate sentences with large sampling probability and high rewards from the discriminator.
the weight of samples W φ (X) can be calculated as follows: So far, we can successfully optimize the generator's loss L G θ via Equation 6.