A "cloze1" evaluation would aim to predict {(499, 2199)} as the missing 3 Since that expression is the product of both probability distributions and probability densities, our "cross-entropy" metric is actually the sum of both entropy terms and (potentially negative) differential entropy terms.
a value of 0 has no special significance.