Define , thus the outputs of i-th sentence-level co-attention mechanism are computed as Like Equation 10, we can also calculate a sentence-level score for the i-th word sense by a dot product of the context vector c s i and the gloss vector g s i : The sentence-level context embedding vectorĉ s is also computed as the average of N gloss-aware context vectors c s i : 3.4 Output Layer The output layer aims to calculate the scores of N senses of the target word x t and finally outputs a sense probability distribution over the N senses.
finally, the probability distributionŷ over all the senses of the target word is computed aŝ where λ xt ∈ [0, 1] is the parameter for word x t .