While the sentence-paraphrase pairs that are labeled entailed and rated 3.0 and above are usually grammatically correct, the sentences with an average rating below 3 and labeled entailed sometimes contain a grammatical errors, and some are rated neutral or contradictory.
we remove sentences with an average rating less than or equal to 3.0 and greater than 2.5.