This has computational advantages (no potentially infinite Z(Θ) terms to compute).
the set of conditional distributions of labels given terminals that can be expressed by MEMMs is strictly smaller than those expressible by HMMs (and by extension, Mealy MRFs).