HITs were automatically approved after fifteen minutes.
then By normalizing (and rounding), 11 Although the majority vote on i is for category 1, the estimated probability that the category is 1 is only 0.11, given the adjustments for annotators' accuracies and biases.