Previous works have proven it will greatly improve the performance to exploit the pre-trained character embeddings instead of that with random initialization.
we pre-train the embeddings on a huge unlabeled data, the Chinese Wikipedia corpus, with word2vec toolkit (Mikolov et al., 2013).