We see that having no regularization (λ = 0) fails on all three L1s, due to overfitting on the smaller in-domain data.
the effect of varying regularization is more significant on L1 Russian and Spanish, as the general NNJM has seen much smaller in-domain L1: Chinese L1: Russian L1: Spanish data compared to L1 Chinese.