The agent tends to focus on learning from the ensemble model rather than exploring its own prediction to converge rapidly.
in this paper, according to the Generate sequence: Compute KD loss: Compute NLL loss: Compute Agent loss: Model loss: 13 Update gradients for each agent; 14 end 15 until convergence; previous experiments, we find that a simple multitask learning technique without sharing any modules presents promising performance, in Algorithm 1, we describe the overall procedure of our approach.