The ML estimators of entropy are consistent but heavily negatively biased (see Section 3 for details).
the expectation ofĤ is lower than the true entropy, and this discrepancy increases with the number of clusters m and decreases with the sample size N. When m is comparable to N, the ML estimator is known to be very inaccurate (Paninski 2004).