For these experiments, we use the dataset published as part of word2vec 5 , which consists of 8,869 semantic and 10,675 syntactic questions of this type (Mikolov et al., 2013).
word similarity measures the correlation 6 between the similarity scores produced by a model and a gold standard created by human annotators for a given set of word pairs.