To help replicate our results, we publish our code 3 , which is developed from our codebase for multiple tasks (Chen et al., 2018;Chen et al., 2017a;Chen et al., 2016;.
we use Adam (Kingma and Ba, 2014) for optimization.