At the same time, larger corpora may also tend to be more broad in scope and variable in style and topic, leading to less idiosyncratic patterns in word co-occurrence.
for each corpus, we curate a smaller sub-corpus that contains 20% of the total corpus documents.