This rate will descend as the classifiers get more and more robust in their predictions on unseen data.
an average disagreement approaching zero can be interpreted as an indication that additional annotations will not render any further improvement.