The last term is the entropy of the partitions at the current step which is bounded between zero and k. Hence, the KL divergence is at most k at each step.
if the probability mass is roughly evenly distributed over each of the 2 k bins, then the KL divergence is close to zero.