In preliminary experiments, we found that most of the gain came from unigrams and bigrams, with little to no additional gains from trigrams.
we limited our experiments to bigram pFSM and pPDA models, and pruned the paraphrase table adopted from TERplus 5 to unigrams and bigrams, resulting in 2.5 million paraphrase pairs.