Note that datasets with different vocabulary size can lead to different entropy: the entropy of picking a word from the vocabulary uniformly at random would have been different.
recall from Section 4 that our comments dataset contains roughly 237K repliers and 357K original com- menters.