As the Simon model had more new words later in a sequence, the correlation stayed large even for two sequences with a large distance between them.
§8 discusses evaluation of GAN models for text generation.