A potential solution for this issue is improving the training signal to enhance preserving of structural information.
applying Loss 1 alone achieves an improvement of 1.36 BLEU points, and Loss 2 alone obtains 0.66 more points than Loss 1.