We use a standard model based on BERT (Devlin et al., 2019) as our NLI model.
we used the base-uncased pre-trained model from the pytorch-pretrained-bert library 4 , and fine-tuned it for the NLI task on MultiNLI.