To avoid underflow, Equation (1) is estimated as the following log probability: where c(x) is the count of word x, c(•) is the corpus size, c(x, y) is the joint count of x and y, and |v| is the dimension of vector v. Nonetheless, we do investigate how model performance responds to estimation quality.
in WSD, a source corpus is defined as the source of the majority of the WSD instances in a given dataset, and a baseline corpus of a smaller size and less resemblance to the instances is used for all datasets.