All models are optimized using Adam optimizer (Kingma and Ba, 2014) with gradient clipping equals to 5 (Pascanu et al., 2012).
numerous existing models (Tang et al., 2016b;Tay et al., 2017;Fan et al., 2018;Xue and Li, 2018) typically utilize an aspect-independent encoder to generate the sentence representation, and then apply the attention mechanism (Luong et al., 2015) or gating mechanism to conduct feature selection and extraction, while feature selection and extraction may base on noised representations.