Let s 1 , s 2 ∈ S be two sentences: this rule is violated if, according to the model, a sentence s 1 contradicts s 2 , but s 2 does not contradict s 1 .
if we just use the final decision made by the neural NLI model, we can simply check whether the rule is violated by two given sentences, without any information on the degree of such a violation.