This is therefore a coarse abstraction of the structured prediction tasks presented in this paper.
so, though conceptually, the annotations by two people are similar, this is not captured by our calculation of inter-annotator agreement.