Here are three ways of making the intuitive idea of bias correction concrete: (1) The complement-based BCM rule (ComBCM) is defined by weights .
the weight of annotator i for category X is equal to her relative frequency of having chosen the other category 1−X.