In this paper, we propose a novel retrieve-andrewrite initialization method for UMT.
we first retrieve semantically similar sentence pairs from monolingual corpora of two languages with the help of unsupervised cross-lingual sentence embeddings.