The best accuracy we achieve on labeling a claim accompanied by the correct evidence is 31.87%, while if we ignore the evidence we achieve 50.91%.
we believe that FEVER is a challenging testbed that will help stimulate progress on claim verification against textual sources.