Relying on bilingual image tags and descriptions, our approach conditions text embedding induction on the shared visual information for both languages, producing highly correlated bilingual embeddings.
we propose a novel model based on Partial Canonical Correlation Analysis (PCCA).