However, one document may contain multiple types of events, thus we set a more restricted validation measure on new rules: • Good Match If a new rule "rediscovers" already extracted events of the same type, then it will be counted as either a Full Match or Partial Match based on previous rules • Possible Match If an already extracted event of same type of a rule contains same entities and trigger as the candidate extracted by the rule.
this candidate is a possible match, so it will get a partial  • False Alarm If a new rule picks up an already extracted event in different type event patterns are validated for overall expected precision by calculating the ratio of positive matches to all matches against known events.