Setting the larger batch size implies the more accurate corpus-BLEU, but at the cost of slower convergence of SGD.
we propose an optimized update method inspired by the passive-aggressive algorithm (Crammer et al., 2006), in which each parameter update is further rescaled considering the tradeoff between the amount of updates to the parameters and the ranking loss.