By evaluating pruned models on the held-out data, optimal settings can be found.
the increase in relative entropy from pruning a bigram is computed by where the summation is over all word pairs (w i-1 w i ).