Empirical studies show that our approach can significantly improve in translation quality with an increased model depth.
we achieve 1.0 and 0.6 BLEU score improvement over the strong Transformer baseline in English→German and English→French translations.