Existing datasets for scoring text pairs in terms of semantic similarity contain instances whose resolution differs according to the degree of difficulty.
2017, we assign a positive label if relatedness ≥ 4 and a negative one otherwise to use a similar criterion as in the other datasets.