For simplicity, we ignore the superscript t. We design the Sememe Predictor as a linear decoder with the sigmoid activation function.
q k , the probability that the next word contains sememe e k , is formulated as where v k 2 R H 1 , b k 2 R are trainable parameters, and (•) denotes the sigmoid activation function.