A scope-level F β=1 measure was used as the chief evaluation metric where true positives were scopes which exactly matched the gold standard cue phrases and gold standard scope boundaries assigned to the cue word.
correct scope boundaries with incorrect cue annotation and correct cue words with bad scope boundaries were both treated as errors.