The evaluation was focused solely on English, and it rarely concerned other languages (Adi et al., 2017;Conneau et al., 2017).
many 'core' methods to learn distributed sentence representations are largely under-explored in a variety of typologically diverse languages, and still lack a demonstration of their usefulness in actual downstream tasks.