By introducing a universal channel in our language model we reduced a representations dependence on a single language.
we can utilize an arbitrary set of languages in training an auxiliary task over UG encodings.