Figure 1: Adversarial evaluation in NLP typically focuses on a specific phenomenon (e.g., word replacements) and then generates the corresponding examples (top).
adversarial examples are limited to the diversity of what the underlying generative model or perturbation rule can produce-and also require downstream human evaluation to ensure validity.