However, instead of hard-switching between the experts, each sample uses a convex combination of all experts, dictated by an expert gate.
at test time, the trained expert gate can decide the optimal expert weights for the unseen target language based on its similarity to the source languages.