(2019) proposed an aggressive inference network training.
for text modeling, researchers have shown that SGD performs better than other adaptive optimization methods such as Adam (Wilson et al., 2017;Keskar and Socher, 2017).