We regarded these sets of labels assigned to the span as a single annotation, i.e., concatenated each type of label as a single label.
we examined the agreement rate of an exact match of all possible annotation labels.