The presence of discrete latent variables z, however, presents a challenge to training the neural KEAG model, since the backpropagation algorithm, while enabling efficient computation of parameter gradients, does not apply to the nondifferentiable layer introduced by the discrete variables.
gradients cannot propagate through discrete samples from the categorical distribution P (z t |F, s r t ).