This is a reasonable assumption in the Corel dataset, where the annotations have similar lengths and the words reflect the salience of objects in the image (the multinomial model tends to favor words that appear multiple times in the annotation).
in our dataset the annotations have varying lengths, and do not necessarily reflect object salience.