closed challenge, Macro F 1 score.
scores can also be computed for a number of other conditions: • Task: Joint or SRL-only • Challenge: open or closed • Domain: in-domain data (IDD, separated from training corpus) or out-of-domain data (OOD) Joint task participants are also evaluated separately on the syntactic dependency task (labeled attachment score, LAS).