To detect whether an essay is adversarial, we further augment the system with an adversarial text detection component that simply captures adversarial input based on the difference between the predicted essay and coherence scores.
we use our development set to learn a threshold for this difference, and flag an essay as adversarial if the difference is larger than the threshold.