We adapt the HDP machinery to tie these binary production distributions together.
to cope with unknown words, we replace any word appearing fewer than 5 times in the training set with one of 50 unknown word tokens derived from 10 word-form features.