While the full JRC corpus contains roughly 180k word types and consists of approximately 70M running words, the full Gigaword corpus contains around 2M word types and roughly 1.5G running words.
it contains some mistakes and ambiguities: For example, it contains misspelled words like forrest (vs. forest), experence (vs. experience), or paradice (vs. paradise).