The markedness measure can be analyzed in terms of point-wise mutual information (pmi), indicating the amount of information one relation has for the distribution of the words that follow it (Hume, 2011).
because pmi is proportionate to npmi, we can rewrite (2) as We also have the mutual information measure: For the mutual information of y i in Y :  the markedness measure can be understood as the Kullback-Leibler divergence of the univariate distribution of X from the conditional distribution of X given y i (a discourse relation in our case).