For the experiment with lexical generalisation, functional words (stop words) were removed and all remaining (content) words were generalised using their WordNet synsets, that is, groups of synonym words.
for practical reasons, in this paper we selected a subset of the PAN corpus: the first 1,000 suspicious documents, along with all 11,147 source documents.