To learn in this paradigm, instead of using the pre-trained word embeddings as fixed training samples, at every training step we obtain samples from the Gaussian mixture space.
our method is exploring the entire embedding space instead of only the specific points assigned for observed words.