The decoder predicts a word conditioned on the correct word sequence (y t−1 1 ) during training, whereas it does with the predicted word sequence (ŷ t−1 1 ) at test time.
the key difference from MLE is that the reward is not restricted to tokenlevel accuracy.