Evaluating the claimevidence reasoning of these models necessitates unbiased datasets.
we suggest a way to turn the evaluation FEVER pairs into symmetric combinations for which a decision that is solely based on the claim is equivalent to a random guess.