This provides further evidence that M-BERT uses a representation that is able to incorporate information from multiple languages.
m-BERT is not able to effectively transfer to a transliterated target, suggesting that it is the language model pre-training on a particular language that allows transfer to that language.