Note, however, that this renormalization factor is necessarily less than one, and thus would uniformly increase each word's probability under the model, that is, any perplexity results reported below will be higher than the "true" perplexity that would be assigned with a properly normalized distribution.
renormalizing would make our perplexity measure lower still.