We evaluate the performance by the top k (k = 1, 2) accuracy (A@1, A@2), average token-level F 1 score (F 1 @1), and mean reciprocal rank (MRR).
the accuracy and MRR are calculated at the segmentation-level, which means that an output segmentation is considered correct if and only if it fully matches the human segmentation.