Our goal here is not to find the best possible way to do the post-ranking, but only to show that gains are possible.
running the preranker over a larger candidate list is not enough; we find that it is better to see what edits are made for multiple candidates before making the final decision.