The WORDSIM353 (Finkelstein et al., 2001) dataset provides relatedness scores of 353 noun pairs and the SIM-LEX999 dataset provides similarity scores for 666 noun pairs, 222 verb pairs and 111 adjective pairs.
the latter's emphasis is to model opposite meanings (antonym-like) as highly non-similar, e.g.