As an initial step, we can recognize informal words and segment the Chinese words in the sentence by applying joint inference based on a Factorial Conditional Random Field (FCRF) methodology (Wang and Kan, 2013).
as our focus in this work is on the normalization task, we use the manually-annotated gold standard informal words (O) and their formal equivalents (T ) provided in our annotated dataset.