: word break, named entity recognition and morphological analysis) in a unified approach.
it is difficult to develop a training corpus where new words are annotated because "we usually do not know what we don't know".