The i-th generator can get a high reward only when sentence Y i is recognized as a paraphrase of X by the paraphrase discriminator and the differences between Y i and sentences generated by other generators is so large that generator discriminator takes Y i as a sentence generated by the i-th generator.
we use the self-critical algorithm (Rennie et al., 2017) as our reinforcement learning method.