The unigram model is a reasonable segmenter, though not quite as good as the bigram model, with boundary F of 76.4 and token F of 60.9 (compared to 79.8 and 64.4 using the bigram model).
it is not good at normalizing variation; its mtk score is comparable to the baseline at 44.8% 5 .