Therefore, we evaluate DEE by directly comparing the predicted event table with the groundtruth one for each event type.
for each document and each event type, we pick one predicted record and one most similar ground-truth record (at least one of them is non-empty) from associated event tables without replacement to calculate event-role-specific true positive, false positive and false negative statistics until no record left.