Empirical results show that the proposed approach consistently improves the residual-based models and exhibits desirable generalization ability.
by incorporating the proposed approach to the Transformer model, we establish new state-of-thearts on the IWSLT-2015 EN-VI low-resource machine translation dataset.