11in Appendix E. In order to stabilize the learning process, we use standard variance reduction techniques to reduce the variance of gradient (Greensmith et al., 2004;Mnih and Gregor, 2014;.
we first standardize the signal (rescaling it to zero mean and unit variance) and then subtract a baseline function b(x).