The idea now is to smooth the representation of a word in the latent semantic space induced only by the words in its local context with the out-of-context type-based representation of that word induced directly from a large training corpus.
the modulated probability score P (z k |w S 1 ) from eq.