The language embeddings need to represent all of the languagespecific information and thus may need to be large in size.
when computing the parameters of each group, only a small part of that information is relevant.