In the training with the REINFORCE algorithm, the speedup by our method is enhanced.
in the En-Ja (2M) experiments, our method gains a factor of 2.7 speedup compared with the full softmax baseline (S = 3).