Here, we follow a similar process as in (Wen et al., 2015) which generates multiple target hypotheses with stochastic sampling based on p(T |S), and then ranks them with the objective function 2 above.
as also observed by (Shao et al., 2017), step-by-step naive sampling can accumulate errors as the sequence gets longer.