After their release, very large language models (LMs) were able to reach or surpass human-level performance on SNLI (Peters et al., 2018) and SWAG (Devlin et al., 2018).
researchers have found inadequacies in these datasets and the models trained on them.