One obvious disadvantage of generative models is that they maximize the likelihood of training text but never see the incoherent text.
to produce a binary classification decision about coherence, such a generative model only sees data from one class.