This limits our understanding of CLE methodology as: 1) BLI is an intrinsic task, and agreement between BLI and downstream performance has been challenged (Ammar et al., 2016;Bakarov et al., 2018); 2) BLI is not the main motivation for inducing cross-lingual embedding spacesrather, we seek to exploit CLEs to tackle multilinguality and downstream language transfer (Ruder et al., 2018b).
previous research does not evaluate the true capacity of projectionbased CLE models to support cross-lingual NLP.