In the reasoning phase, we mainly utilize BERT (Devlin et al., 2019) as our encoder for the cells and passages due to its strong semantic understanding.
we use four BERT variants provided by huggingface library 3 , namely baseuncased, based-cased, large-uncased, and largecased.