In Algo-rithm 1, L C , L D and L g are the loss functions for the predictor C, the language discriminator D, and the expert gates in F p and C, respectively.
in addition, note that D is trained using unlabeled corpora over all languages (∆), while the training of F p and C (and hence G) only take place on source languages (S).