We limited our first study reported here to linear classifiers, in which conversion can be performed by simple ordering according to the score of each document.
approaching the problem as "learning how to order things" allowed us to design our sampling and training mechanisms in a novel and, we believe, more powerful way.