In these experiments, given a pair of words, the system needs to predict if the first word entails the second one or the other way around.
it is known that entailment holds for the pair but its directionality needs to be predicted.