But as (Levy and Goldberg, 2014) showed that the Skip-gram loss function extracts interesting linguistic features, we wanted to use a loss function for the cross-lingual objective that will be closer to Skip-gram than Bil-BOWA.
we introduce a new task, Transgram, similar to Skip-gram.