Figure 4 and the results from Table 5 suggest that perplexity is a good loss function for training paraphrase generation models.
a more ideal metric to fully encode the fundamental objective of paraphrasing should also reward novelty and penalize redundancy during paraphrase generation, which is a notable limitation of the existing paraphrase evaluation metrics.