In these studies, clear word segmentations were assumed to exist.
since Japanese is unsegmented, the normalization problem needs to be treated as a joint normalization, word segmentation, and POS tagging problem.