In particular, we enrich the BERT fine-tuning process with an SS-GAN perspective, in the so-called GAN-BERT 1 model.
a generator produces "fake" examples resembling the data distribution, while BERT is used as a discriminator.