The weights are computed using a novel neural attention mechanism that enables the model to focus on a small subset of the entities that are less ambiguous in meaning and more relevant to the document.
the attention mechanism is designed to compute weights by jointly addressing entity linking and entity salience detection (Ga-mon et al., 2013;Dunietz and Gillick, 2014) tasks.