We also evaluated the annotation quality of the corrected corpora, against ground-truth (OntoNotes does not include event answer-keys so we only focused on the ACE and carbon sequestration corpora).
for each novel event type, we identify relevant and salient sentences involving new event triggers, and then correct errors based on uncertainty estimation, and finally map semantic roles into event argument roles based on semantic frame descriptions.