We formulate the variational posterior as a multivariate Gaussian with diagonal covariance.
an issue with the approach described so far is the number of parameters grows linearly in the size of the vocabulary and in the number of covariate partitions, i.e., O(|V | × |C|), where C is the set of all partitions.