We compute a word-pair's entropy by considering it as a distribution over features, in a manner that is analogous to the feature entropy defined in (Turney, 2006).
the normalized entropy of a word-pair wp is: is the conditional probability of f occurring in the context of wp.