To improve performance at different data sizes we set the mini-batch size to 6K tokens for the 30K-sentence datasets, 12K tokens for 0.5Msentence datasets, and 24K for the remaining larger datasets (Popel and Bojar, 2018).
to the best of our knowledge, this problem has not yet been directly addressed in the NLG setting.