Regarding the errors made during the identification of specifying occurrences, this goal may be met by basing the measures on the sets 0++, 0+_, o+.7, 0+_, and 0+, that constitute the cases in which the base entity to be decided upon, namely, the pronoun occurrence P, has been determined in compliance with the key.
by further drawing the usual distinction between precision and recall, according to which, in the latter case, one must take into account empty anchors A as well, one obtains the following definitions: 34 JOq_q_ I Io++1 + Io+-I + Io+?1 Io++1 + Io+-I + Io+.71 + Io+_l Since errors in the occurrence identification are excluded from measurement at this stage of evaluation, and, moreover, it is assumed that there are no errors regarding the classification of occurrences as decision-relevant entities (i.e., pronouns), 3s it follows that, in any case, P > R. the characteristic trade-off relation between precision and recall holds anyway.