One randomly maps each such word to a cluster, using a probability proportional to the number of unique known words already assigned to that cluster.
explicit modifications to these algorithms were introduced in order to bias their model to produce such a distribution (see (Clark, 2003;Johnson, 2007;Reichart et al., 2010b)).