Therefore, we use the word alignment information from the ART model to help the training of the NART model.
we minimize KL-divergence between the per-head encoder-to-decoder attention distributions of the teacher and the student to encourage the student to have similar word alignments to the teacher model, i.e.