Existing models are optimized by maximizing the conditional word probabilities of a reference sentence, a common signal for training language models.
these models can learn to produce fluent sentences, but some crucial input concepts and relations may be messed up or even dropped.