In our setting, however, n-best lists are problematic; early experiments showed that a 10,000-best list for a typical message only accounts for 50% of message log perplexity.
the posterior marginals in our model are (at least initially) fairly flat.