We find that certain prompts consistently cause all models to generate toxicity (e.g., the four prompts in Figure  1).
there are 327 prompts that yielded at least one generation with 0.9 TOXICITY from all models, and 1,225 prompts when considering only the out-of-the-box language models (i.e., GPT-1, GPT-2, GPT-3, CTRL, CTRL-WIKI).