In this scenario the human teacher marks the correct parts of the machine-generated output y.
every token in the output receives a reward δ t , either δ t = 1 if marked as correct, or δ t = 0 otherwise.