We deal with this problem by introducing distractors -items that are not produced by our algorithm, but are similar enough to not be easily identifiable as "fakes".
for each possible part of speech of each of our system's outputs c that exists in WordNet, we choose a distractor that is either in a "sibling" synset (a hyponym of c's hypernym) or an antonym.