We represent each word with a Gaussian mixture with K Gaussian components.
a word w is associated with a density function are the mean vectors and {Σ w,i } are the covariance matrices, and {p w,i } K k=1 are the component probabilities which sum to 1.