However, this is hard to transfer to languages like English and Vietnamese where single characters are less informative and tokens are much longer, resulting in a larger combinatory label space.
we choose a semi-Markov formalization to directly model segments.