We perform such updates at regular intervals, but they can only be meaningfully applied to the adjudicated gold standard, not individual annotations.
our reliability is likely underestimated by the analysis above.