Our preliminary results showed that the distribution of paraphrase to nonparaphrases from this method is highly imbalanced (about 1:4 ratio).
we seek to create a balanced dataset, so we use an additional strategy based on back translation-which has the opposite label distribution and also produces greater diversity of paraphrases while still maintaining a high BOW overlap.