In these studies it was assumed that clear word segmentations existed.
since Japanese is an unsegmented language the normalization problem needs to be treated as a joint normalization, word segmentation, and POS tagging problem.