Let (s i ,t i ) be a pair of paraphrase units, their paraphrase likelihood is computed using a score function φ pm (s i ,t i ).
replacement rate (rr): rr measures the paraphrase degree on the development set, i.e., the percentage of words that are paraphrased.