Public competitions, such as the well-known CoNLL shared tasks, provide one natural way to obtain a variety of system outputs on the same test set.
it appears that they do achieve higher confidences at lower metric gains.