Recent distributional representations of words exhibit semantic consistency over directional metrics such as cosine similarity.
neither categorical nor Gaussian observational distributions used in existing topic models are appropriate to leverage such correlations.