For this, we use cross entropy and joint entropy: Cross entropy measures the difference between two distributions.
the cross entropy for the distributions X and Y over a given set is defined as: where H(X) is the entropy of X, and D KL (X||Y ) is the Kullback-Leibler divergence of an estimated distribution Y from true distribution X.