In addition, the huge volume of native data benefits the decoder to learn better to generate a fluent and error-free sentence.
we first train a seq2seq error generation model Θ gen with S * which is identical to S * except that the source sentence and the target sentence are interchanged.