The weighting component receives all features k for n and n , and the span representations e n and e n as input, where e n and e n help selecting appropriate knowledge based on the context.
for a candidate pair (n, n ) and a knowledge source i, its knowledge attention score is computed via where o i n,p = [e n , k i n,p ] and o i n ,p = [e n , k i n ,p ] are the concatenation of span representation and external knowledge embedding for candidate n and n respectively.