The main datasets we are using are listed in Table 2, which provides an overview of its description and capacities.
we follow (Zhang et al., 2015;Goo et al., 2018;Williams et al., 2018) to pre-process the document classification datasets, natural language understanding dataset and natural language inference dataset.