It is widely agreed that identifying paraphrases is a core task for natural language processing, including applications like document summarization (Barzilay et al., 1999), Recognizing Textual Entailment (Dagan et al., 2005), natural language generation (Zhao et al., 2010;Ganitkevitch et al., 2011), and machine translation (Marton et al., 2009).
for evaluation, we use all episodes except no.