First, we confirm that with AdvCls (Figure 1a), the hypothesisonly classifier (c hypoth ) is indeed trained to perform poorly on the task, while the normal NLI classifier (c NLI ) performs much better.
retraining a classifier on frozen hypothesis representations (c Hypoth , retrained) boosts performance.