Earlier work simply relied on word occurrence information only (Rapp, 1995;Fung, 1996) while later efforts have considered more sophisticated statistics in addition (Haghighi et al., 2008).
• Unlike previous models which only consider cross-lingual transformation in a single direction, our model jointly learns the word embedding transfer in both directions for each language pair.