On the one hand, annotators achieved κ = 0.345 (z = 92.2, p < 0.0001) (fair agreement) 6 when choosing targets to be added or removed.
they achieved a similar score of κ = 0.341 (z = 77.7, p < 0.0001) (fair agreement) when annotating the sentiment of the resulting targets.