The encoder and decoder structures allow us to learn a mapping within and across languages.
for a given document pair (x E , x C ), we can learn bilingual embeddings to reconstruct The sum of 5 losses is used as the loss function of bilingual embeddings: In the unsupervised phase, we have learned the bilingual embeddings, which could capture the semantic information within and across languages.