Our combined system, TagLM, uses the LM embeddings as additional inputs to the sequence tagging model.
we concatenate the LM embeddings h LM with the output from one of the bidirectional RNN layers in the sequence model.