We assume that the decisions only depend on a limited window of around the current word and on the two predecessor tags.
we obtain the following second-order model: A well-founded framework for directly modeling the posterior probability is maximum entropy (Berger et al., 1996).