A total of 20 systems participated in the closed challenge; 13 of them in the Joint task and seven in the SRL-only task.
we compute macro precision and recall scores by averaging the labeled precision and recall for semantic dependencies with the LAS for syntactic dependencies: 3 where LM P is the labeled macro precision and LP sem is the labeled precision for semantic dependencies.