This provides clear evidence of M-BERT's multilingual representation ability, mapping structures onto new vocabularies based on a shared representation induced solely from monolingual language model training data.
dE i ), we compute the vector pointing from one to the other and average it over all pairs: where M is the number of pairs.