Analytical Setting One anticipated problem with our expanding method in Step-1 is that the extracted data may have a different sense distribution from test data.
to investigate trends based on sense distribution, we employed the entropy E(w) of the frequency distribution in given training data, which is given by where p(s k |w) is the probability that word w will be sense s k .