For implementation of Q, we use a discriminative variant of ENTI-TYNLM by taking the current word x t for predicting the entity-related variables in the same time step.
in the generative story described in §2.2, we delete step 3 (words are not generated, but rather conditioned upon), move step 4 before step 1, and replace h t−1 with h t in the steps for predicting entity type R t , entity E t and mention length L t .