Our framework consists of the following components: a semantic model to be evaluated, pairs of sentences that are considered to have high similarity, and pairs of sentences that are considered to have low similarity.
the semantic model is a binary function, s = M(x, x ′ ), which returns a realvalued similarity score, s, given a pair of arbitrary linguistic units (that is, words, phrases, sentences, etc.