Computing the unigram and bigram KL divergence with a uniform distribution instead of the model yields a value of 4.35 and 1.87, respectively.
all models learned a much better distribution, suggesting that this is indeed a useful metric.