For training embeddings in controlled low-resource settings with our 4 "simulation" languages, we sample nine data points to simulate low-resource scenarios with WE data.
we sample 10K, 20K, 50K, 100K, 200K, 500K, 1M, 2M, and 5M tokens of article text for each of the 4 languages.