The discrepancy could be due to the fact that the script that the authors shared with us was optimized for PTB, and some of the settings might need to be changed for Text8.
since we have not found such differences reported in the paper, we used the same setting for both datasets.