With the result in Table 2, it is true that these pre-trained word embeddings have a good effect on our performance (we use word2vec 3 on Chinese Gigaword Corpus for word pre-training).
as shown in Table 2, compared to standard pre-training, the influence of heterogenous data is more evident.