We manually inspected 30 reference answers which were annotated incorrectly and found that of those, about 95% were indeed incorrect.
62% are actually answerable from some paragraph, indicating that the real ceiling performance on this dataset is around 90% and that there is still room for improvement on this task.