(2006a), binary features were trained only on a small development set using a variant of voted perceptron for reranking k-best translations.
the improvement is merely relative to the baseline translation system, namely whether or not there is a good translation in their k-best.