We can see that the percentage of the number of bigrams pruned by both criteria seems to increase as the model size decreases, but all criterion-pairs have overlaps much lower than 100%.
we find that the average overlap between probability and entropy is approximately 71%, which is the biggest among the three pairs.