Auxiliary task level distribution also plays a role, as we will discuss in Section 4.3, FREQBIN-UNIFORM consistently outperforms the skewed measure with base 5 and 10.
they all have in common that their O class is highly indicative of function words, an argument supported by their similar values of fulldistribution entropy.