Such unbalanced probability makes models mentioned above tend to simply regenerate the original utterance to maximize the conditional probability of the generated sentence during the beam-search process.
the Seq2Seq model and pointer generative network tend to regenerate the original utterance and cannot effectively restore the original utterance.