Additionally, we report the average log-loss (the negative log-likelihood, according to the classifier, of the true label).
in our dataset, every item is labeled in 6 conditions (every |C i | = 6), and within every context, every item is labeled by at least 3 annotators (every |A c i | ≥ 3).