Besides, Kurach also advocates that the gradient penalty (GP) regularization devised in (Gulrajani et al., 2017) will further improve the stability of the model.
the objective function of the proposed AEM is defined as: where L d denotes the discriminator loss, L gp represents the gradient penalty regularization loss, λ is the gradient penalty coefficient which trade-off the two components of objective, ⃗ d * could be obtained by sampling uniformly along a straight line between ⃗ d r and ⃗ d f , P d * denotes the corresponding distribution.