According to our empirical analysis, the percentage of repetitive words drops from 8.3% to 6.5% by our proposed methods on the IWSLT14 De-En test set, which is a 20%+ reduction.
during training, the predictions at different positions can be estimated in parallel since the ground truth pair (x, y) is exposed to the model.