Compared with Row 1 and 4, loss mse + enhanced (Row 3 and 6) increases little parameters about 0.6M and 2.1M, train and decode speed drop very little.
it has greatly improved the translation performance.