Recently, BERT (Devlin et al., 2019) has advanced the state-of-the-art on multiple natural language understanding tasks.
multilingual BERT enables learning representations of sentences under multilingual settings.