We can guarantee that ) viewed as a function of p. By definition: We wish to find the distribution p that minimizes H(p||π ).
clearly, we accomplish that by placing all the mass of If there is more than one minimizer, H(p||π ) is minimized by any distribution p that distributes all its mass among the minimizers of − log π we minimize H(p||π , which is to say, by labeling x as predicted by π (t+1) .