quality ratings, is related to the task of sentence-level quality estimation (sQE).
there are crucial differences between sQE and the reward estimation in our work: sQE usually has more training data, often from more than one machine translation model.