It means, however, that if there is disagreement on the first label potential agreements on the second and third labels do not count.
if two annotators agree on the first label but not on the rest, this can return a higher value than weighted kappa.