In this section, we assess the performance of language models on varying quantities of data, across a number 1,000 10,000 100,000 200 of different source-target language pairs.
we now proceed to discuss the challenges of this data to explore why the positive results of language model pre-training that were seen in Section 4 were not seen in this experiment.