In a critical part of his derivation Simon gives an initial probability to a new word found in the corpus as it introduces some new meaning not expressed by previous words.
as the number of words increases new ideas are frequently expressed not in single words, but in multi-word phrases or compound words.