2010combined the one class per word type constraint (Brown et al., 1992) in a HMM with a Dirichlet prior to achieve both forms of sparsity.
central to our approach is a new type-based sampling algorithm for hierarchical Pitman-Yor models in which we track fractional table counts.