Many researchers have studied previous (non-Transformer) models to understand their actual behavior under different scenarios, showing that these models are taking advantage of clues or failures of datasets and that slight perturbations on the input data can severely reduce their performance.
recent models have not been systematically tested with adversarial-examples in order to show their robustness under severe stress conditions.