For this reason, HMMs have been standardly used with current word-current label, and previous label(s)-current label features.
if we incorporate information about the neighboring words and/or information about more detailed characteristics of the current word directly to our model, rather than propagating it through the previous labels, we may hope to learn a better classifier.