For the neural tagging model, in addition to a BiL-STM layer for encoding words, we set a BiLSTM layer for encoding characters, which supports us to derive character-level representations for all words.
vectors from the characterlevel LSTM is concatenated with the pre-trained word embedding before feeding into the other word-level BiLSTM network to capture contextual information.