This also implies that the discrepancy between counts of high-frequency and lowfrequency words increases with the size of the corpus, as well as the number of those low-frequency words.
distributed word representations of low-frequency words are difficult to learn.