The original BERT model is pre-trained with both Wikipedia and the Books corpus (Zhu et al., 2015), the former of which contains our (unrevised) test targets.
the collected annotation examples are noisy since a sentence s may only be partially supported by the table t.