On inspection, this model is mostly predicting SUPPORTED for most adversarial instances.
it has been observed in related NLP tasks that as models become more complex, it is difficult to fully understand and characterize their behaviour (Samek et al., 2017).