p S (y t ) denotes the generation probability of the target word given the specificity control variable s. Here we introduce a Gaussian Kernel layer to define this probability.
we assume that each word, beyond its semantic representation e, also has a usage representation u mapped by usage embedding matrix U.