Let us explore the repartition of the partition function values during the last epoch of training.
since values of P n are always smaller than 1 and k = 100, and knowing the partition function at the beginning of training is large for all contexts, we can assume that r θ (ŵ i |H) will be large for a least part of the set of noise samples (ŵ i ) k i=1 .