Using data from the scientific domain, we have shown that we can achieve significant reductions in perplexity on held-out data using these models.
here, we see that Bhattacharyya and hellinger (well motivated distances for probability distributions) outperform the Euclidean metrics.