A further effect of control variates is to reduce the magnitude of the gradient, the more so the more the stochastic gradient and the control variate covary.
since it is a non-differentiable post-processing step, the NMT model cannot directly be trained for this behavior.