To ensure that these texts seem more natural to human eavesdroppers we introduce two parameters to trade off quality for compression: we modulate the LM distribution by a temperature τ , and we truncate the distribution to a top-k tokens at each position to ensure generations do not include tokens from the long tail.
the compression objective is to maximize H(q).