This metric does not account for all possible boundaries in the corpus: theoretically each turn could be split at any space between words.
the metric is quite pessimistic but gives more insight into annotators performance.