To estimate the expectation in Equation 11, we use Monte Carlo sampling on the source selector variables y in the gradient computation.
the Gumbel-Softmax trick is applied to generate discrete samplesŷ from the probability given by: where x r t is the embedding of the answer word in timestep t, W y and b y are learnable parameters.