Each file is relatively small (around 150Mb) and is easy to download and work with locally during the development phase.
to work with the entire corpus we recommend using some kind of parallelism, e.g.