The key advantage of the CRF framework is the flexibility to consider arbitrary features of the input, as well as enough features over the output structure to encourage it to be well-formed and consistent.
inference in CRFs is fast only if the features over the output structure are limited.