To alleviate the concerns to some extent, we consider the case in which the leakage is in the induced negative words distribution.
this setup lends itself to a discriminative training approach, which we demonstrate to work better than generative language modeling.