If we do not want to make any assumptions regarding possible priors for either gold standards or annotation biases (i.e., if we opt for the default assumption of uniform priors), then we can instead work with p(A j | g j = k).
we should choose k over Taking logarithms on both sides, we see that giving each annotator a weight of log (|K|−1) results in an optimal aggregator.