Through this large-scale multilingual analysis, we shed new light on the current limitations of standard LM models and offer support to further developments in multilingual NLP.
we demonstrate that the previous fixedvocabulary assumption in fact ignores the limitations of language modeling for morphologically rich languages.