Recent work showed that these models can be improved if transcriptions are available at training time.
even though the model works on ground-truth text (no translation involved), we still see a 4% drop in R@10 between the reduced english condition and Japanese.