• Extensive experiments on NIST Chinese-English, WMT14 English-German and WMT18 Russian-English translation tasks demonstrate that our SB-NMT model obtains significant improvements over the strong Transformer model by 3.92, 1.49, and 1.04 BLEU points, respectively.
our approach separately establishes the state-ofthe-art BLEU score of 51.11 and 29.21 on Chinese-English and English-German translation tasks.