Compared with N-gram models, syntactic models capture rich structural information, and can be more effective in improving the fluency of large constituents, long-range dependencies and overall sentential grammaticality.
syntactic models require annotated syntactic structures for training, which are expensive to obtain manually.