A small validation set of word similarities from (Jin and Wu, 2012) is used to ensure the embeddings have reasonable semantics.
we use the following equation to compute starting word embeddings: In this equation, S is the number of possible target language words that are aligned with the source word.