This paper studies the idea of removing low-frequency words from a corpus, which is a common practice to reduce computational costs, from a theoretical standpoint.
comparing Zipf and Reuters, we see that C k is poorly estimated when the gram size is large, whereas π k is roughly correct.