If we adopt pre-trained encoders, as in the second and third group, the performance clearly improves for all training sizes.
in the low-resource (1k) settings, the performance drops from the 10k settings are much smaller than those in the first group.