deviation 0.32 0.32 0.32 0.32 0.45 0.36 0.37 0.41 0.36 Table 7: Deviation from average assigned value, all 5 values used (0-4) These deviations are (somewhat surprisingly) larger than the deviations computed after mapping the labels to the binary (Y/N) values only.
the deviation is smaller when the "unsure" labels (R Y , R N ) are mapped to Y and N, and the D value also to N, disregarding the difference between these two.