Our results show that while toxic prompts unsurprisingly yield higher toxicity in generations, nontoxic prompts still can still cause toxic generations at non-trivial rates (Table 2).
all five models have a toxicity probability near or above 0.5 for non-toxic prompts.