The output of this affine transformation is normalized by softmax such that all its values sum to 1.
the predicted sense s i of word x i is formulated as where s i is a vector of predicted sense distribution for word x i , while W lexelt(x i ) and b lexelt(x i ) are respectively the projection matrix and bias vector specific to the lexical element (lexelt) of word x i , which consists of its lemma and optionally its partof-speech tag.