In this paper, we propose a novel cross-lingual pre-training method for unsupervised machine translation by incorporating explicit cross-lingual training signals.
we first calculate cross-lingual n-gram embeddings and infer an n-gram translation table from them.