Jensen-Shannon Divergence is a symmetric version of contextual average mutual information (KL) which is used by (Dagan et al., 1999) as word similarity measure.
constructing such graph and doing graph propagation on it is computationally very expensive for large n-grams.