The forward and backward outputs are concatenated to construct character representations: where ← − h c i and − → h c i denote the forward and backward outputs of bidirectional LSTM.
the final representation of entities will be sent into a ReLU activation function and the softmax layer to predict entity categorical labels.