In this paper, according to the Generate sequence: Compute KD loss: Compute NLL loss: Compute Agent loss: Model loss: 13 Update gradients for each agent; 14 end 15 until convergence; previous experiments, we find that a simple multitask learning technique without sharing any modules presents promising performance, In Algorithm 1, we describe the overall procedure of our approach.
we argue that our model can bring further improvement using their back-translation technique.