Note that when p is a point distribution, H(p) = 0 and hence H(p||q) = D(p||q).
in particular: when, as here, φ x is a point distribution, we can restate the maximum-likelihood criterion as instructing us to choose the model that minimizes the total divergence between the empirical labeling distributions φ x and the model's prediction distributions π x .