However, in any realistic scenario, human feedback will vary from its average, and so the reward that our algorithm receives will be a perturbed variant of sentence-BLEU.
if the sentence-BLEU score is s ∈ [0, 1], the algorithm will only observe s ∼ pert(s), where pert is a perturbation distribution.