In this work, we use a language modelling objective to pre-train language embeddings; we train a character-level neural language model with a distributed language embedding of language .
we use the model ofÖstling and Tiedemann (2017), visualised in Figure 4.