Notably, all perform poorly on I TH instances in which the gold label is changed, with ESIM and CE performing below the level of chance.
on these instances, the models tend to predict the label of the original unaltered training instance and inference in this case is similar to nearest-neighbour prediction.