More complex caching techniques are possible (Goodman, 2001), but are not necessary for this experiment.
we have proposed a fundamental principle of language generation, namely the entropy rate constancy principle.