In our work, we find the use of -greedy with stochastic policy works well enough to encourage exploration.
with a probability of 1 − , the agent chooses the sentence following the current policy, i.e., to sample an index a t ∈ [1, N ] from the multinomial distribution with sentence affinities {µ 1 , µ 2 , .