Predicting Deviation from the Document-Mean: Our active selection strategy only makes use of relative differences between segment scores.
at training time, we replace the label y ji for the i-th segment of the j-th document (system output) by y ji − Q is the true overall quality of the j-th document.