This information is already accessible in the hidden state of the LSTM.
mentions cluster into entities already at the hidden layer h i , with no real difference with the query layer q i (see Figure 7).