Because the lexical entailment relation is directional, each candidate pair was duplicated to create two directional pairs, yielding a test set of 3,200 pairs.
for each pair of words, w and v, the two ordered pairs (w, v) and (v, w) were created to be judged separately for entailment in the specified direction (whether the first word entails the other).