However, due to the constrained space of possible questions defined by QA-SRL's slot format, accuracy-based metrics can still be informative.
we report the rate at which the predicted question exactly matches the gold question, as well as a relaxed match where we only count the question word (WH), subject (SBJ), object (OBJ) and Miscellaneous (Misc) slots (see Table 1).