The Gutenberg texts have copyright information at the beginning and the end, which we removed using heuristics or manually.
specific features, on the other hand, generated by the last layers, are very dependent on the dataset/task (Yosinski et al., 2014).