To allow direct comparisons between the different values of U and UO, these scores are plotted against the proportion of decisions that are different from that which the pure SL policy would choose.
the SL policy (average reward 139.8) is plotted at 0 (which is Average dialogue score plotted against the proportion of decisions that diverge from the SL policy, for different values of the unobservable state reward U and reward offset UO.