Typically, linguistic structures are characterized by sparse distributions (e.g., POS tags are followed with high probability by only a few other tags, and have highly skewed output distributions).
it makes sense to use a Dirichlet prior with β < 1.