One confound that results from collecting annotations on a continuous scale is that each rater may choose to use the scale differently.
we apply z-score normalization to each worker's labels for each assignment, meaning each worker's ratings are rescaled such that the mean across all labels from a single worker within a single batch is 0 and the standard deviation is 1.