The word hidden state w h t attends to the SAM outputs to predict the next word, while the entity label hidden state l h t is used to attend to the keyword memory and predict entity label of next word.
eLSTM is a hybrid of three LSTMs with a deeper interaction between these cells.