Therefore, to investigate trends based on sense distribution, we employed the entropy E(w) of the frequency distribution in given training data, which is given by where p(s k |w) is the probability that word w will be sense s k .
p(s k |w) and then E(w) reflect sense frequency bias.