Interpolation of monolingual LMs is an alternative to obtain a multilingual model (Harbeck et al., 1997;Weng et al., 1997).
interpolated models still require a trained model per language, and do not allow parameter sharing at training time.