We observe that words that are less frequent in both the old and the new domains are more likely to have a new sense than more frequent words, which causes the CONSTANT base-line to perform reasonably well.
it is more difficult for our models to make good predictions for less frequent words.