Thus, although both clusters contain different adjectives, they group adjectives that are on the same scale of a different meaning.
to evaluate the quality of the automatic clustering, we sampled 50 clusters containing three or more adjectives (corresponding to a total of 190 adjectives) from all the generated clusters and obtained annotations using Amazon Mechanical Turk (AMT), a crowdsourcing platform that has been shown useful for a number of NLP tasks (Snow et al., 2008).