As theory predicts, unigram probability estimates for many words do converge as corpus size grows.
contrary to intuition, we found that for many commonplace words, for example tightness, there was no sign of convergence as corpus size approaches one billion words.