To address this problem, the straight-through(ST) estimator (Bengio et al., 2013) is employed to estimate the gradient for the binary random variables, where the derivative of z i w.r.t φ is simply approximated .
the gradients can then be backpropagated through discrete variables.