It can be seen that Gaussian LDA is a clear winner, achieving an average 275% higher score on average.
we are using embeddings trained on Wikipedia corpus itself, and the PMI measure is computed from co-occurrence in the Wikipedia corpus.