It is used in the training of the Tree-LSTM model (Choi et al., 2018), as well as policy refinement in our imitation learning.
we use the straight-through Gumbel-Softmax (ST-Gumbel, Jang et al., 2017).