In turn, we have that : The output y C is guaranteed to contain at least one label A and one label B. t * A in Equation 1 will contain only one token while variables A and B, in reality, often span multiple tokens.
as an additional post-processing step, we run the Viterbi algorithm once more using the identified labels A, B and P as constraints.