A 1 Artstein and Poesio (2008) observe that there are several version of κ which differ in how P (E) is calculated.
fleiss' (1971) κ calculates P (E) as the average observed distribution of all annotators, whereas Cohen's (1960) κ calculates P (E) only on the basis of the other annotator(s).