In preparing the training data, we faced the problem that the completely random sampling of candidate paraphrase pairs provided us with only a small number of positive examples.
we automatically collected candidate paraphrase pairs that were expected to have a high likelihood of being positive as examples to be labeled.