With a value of 0.21 in terms of Fleiss' κ, the annotator agreement is between slight and fair.
when binarizing the classes as described before, κ becomes 0.36, which corresponds to the respective value of 0.35 reported for our previous clickbait corpus (Potthast et al., 2016).