Traditionally, the amount of self-information contained in a tag (as a probabilistic event) depends only on the probability of that tag, and would be defined as I(t j ) = − log p 1 (t j ).
intuitively one can say that a good measure of usefulness of a particular tag should also take into consideration the expected tagging confusion related to the tag.