The intuition is that the context helps to disambiguate the true meaning of the occurrence of the word w S 1 .
after observing the context of the word w S 1 , fewer latent cross-lingual concepts will share most of the probability mass in the modulated context-aware word representation.