The approach has the advantage of not requiring bilingual parallel data, but it suffers from issues typical of distributional similarity metrics.
it produces paraphrases that share the same or similar contexts but are related in ways that do not always characterise paraphrasing, such as antonymy.