However, a model running in the other direction can penalize this omission, as found by Goto and Tanaka (2017).
we obtain the back-translation probability p back of each sampled candidate paraphrase, and define the final score for each candidate paraphrase as the joint probability p * = p generate * p back , which is the sum of negative log-likelihood.