Also, it is commonly known that the parameter of a Dirichlet distribution controls how sparse its samples are.
by making the hyperprior on the Dirichlet distribution for the rows of the transition matrix small, we can encode our belief that any state (corresponding to a PoS tag in this application context) will only be followed by a small number of other states.