However, RL models have poor sample efficiency and lead to very slow convergence rate.
rL methods usually start from a pretrained policy, which is established by optimizing XENT at each word generation step.