The results highlight VECMAP (Artetxe et al., 2018b) as the most robust choice among unsupervised models: besides being the only model to produce successful runs for all language pairs, it also significantly outperforms other unsupervised models-both when considering all language pairs and only the subset where other models produce successful runs.
vECMAP still performs worse (p ≤ 0.0002) than PROC-B (trained on only 1K pairs) and all supervised models trained on 3K or 5K word pairs.