Sampling a specific word y t from the softmax (Eq.
3) is equivalent to adding (element-wise) to the logits an independent noise sample ξ from the Gumbel distribution 1 and taking the arg max: using the GS trick, Eq.