The joint neighborhood discovery and word translation objective is given by: The neighborhood discovery part of the objective, R(θ), does not depend on availability of supervised data and only requires monolingual data on the source language side.
we can discover neighborhoods in an unsupervised manner on a large set of monolingual word embeddings, then initialize using this pre-trained D which is then jointly optimized with the translation part of the objective L(θ).