In some studies, pre-processing is applied in order to improve the performance of CWS models, including substituting consecutive digits and English letters, Chinese idioms and long words with unique symbols (Cai and Zhao, 2016;Chen et al., 2015).
we do not deploy such techniques for fair comparison, focusing only on the possible improvements brought by word embeddings.