To address this problem, we create a differentiable estimator for discrete random variables with the Gumbel-Softmax trick (Jang et al., 2017).
we first compute the discrete distribution P (z t |F, s r t ) with class probabilities π 1 , π 2 , .