However, the lexicon prior alone incorrectly favors the trivial segmentation that shatters each word into characters, which results in the smallest lexicon possible (single characters).
we also impose a corpus prior: an exponential prior on the number of mor-phemes used to segment each word in the corpus, which penalizes over-segmentation.