Many previous works (Lample et al., 2016;Peng and Dredze, 2015b) have shown that pre-trained embeddings on large-scale unlabeled corpus enable to initialize the table and observe efficiently improvements.
in practice we find that the automatically labeled NER data suffers from two problems, i.e., incomplete annotation and noisy annotation, which negatively affect the performance of NER systems.