That is, we choose t 1 for a given s 1 , s 2 as follows: where S b ∈ S is the current mini-batch.
the training data consists of a set S of phrase or sentence pairs s 1 , s 2 from either PPDB (Ganitkevitch et al., 2013) or the aligned Wikipedia sentences (Coster and Kauchak, 2011) where s 1 and s 2 are assumed to be paraphrases.