To evaluate macro content selection, we measured the F 1 score (the harmonic mean of precision and recall) of the set of records chosen with respect to the human-annotated set of records.
the generated text w is a deterministic function of the decisions.