In some cases one could estimate the densities even for off-the-shelf embeddings, but this still requires access to the training data and the usefulness of such post-factum densities is limited (Vilnis and McCallum, 2014).
these approaches are not very helpful to practitioners who are accustomed to using highquality pre-trained word embeddings directly.