In most cases, MLE models do not perform well on out-of-domain datasets, with ECEs ranging from 8-12.
table 6: Out-of-the-box calibration development set results for in-domain (SNLI, QQP, SWAG) and out-ofdomain (MNLI, twitterPPDB, HellaSWAG) datasets using pre-trained models.