Note that we only care about the naturalness of the resulting sentence rather than the meaning retention of the original sentence.
the evaluation is based on the sentence-level naturalness rather than the coherence of the whole document.