We exploit the idea of AT (Goodfellow et al., 2015) as a regularization method to make our model robust to input perturbations.
we generate examples which are variations of the original ones by adding some noise at the level of the concatenated word representation (Miyato et al., 2017).