To better capture long range dependencies and synthesize the information of the sentence, we extend self-attention mechanism into the framework.
we try to improve Chinese NER task performance by incorporating shared boundary information from CWS task.