Therefore, in addition to the dictionary, many systems also contain special components for unknown word identification.
statistical methods have been widely applied because they use a probabilistic or cost-based scoring mechanism rather than a dictionary to segment the text.