The situation is quite different from part-of-speech tagging, or even noun-phrase chunking using sequence learning methods.
for this task both the per-token accuracy as well as the segment precision and recall are equally important in gauging performance.