The training time of order-o CRFs grows exponentially (O(M o+1 )) with the number of output labels M , which is typically slow even for moderate-size training data if M is large.
the training time of order-o MEMMs is linear (O(M )) with respect to M independent of o, so it can handle larger training data with higher order of dependency.