While some proposals use a separate encoder for each language (Schwenk and Douze, 2017), sharing a single encoder for all languages also gives strong results (Schwenk, 2018).
this approach has two obvious drawbacks when trying to scale to a large number of languages.