Top K entities in S t are left to form dynamic context while the others are pruned.
the relevance scores are transformed to attention weights with we can define a weighted coherence score between e j t+1 ∈ E t+1 and S t as where R is a learnable diagonal matrix.