Then, for a topic T from the dataset (W), we select a summary s and ask: among the summaries which are better than s for one metric (N), how many are better for all metrics (F)?
this is given by: Here, m(x) is the score of the summary x according to the metric m. F N measures the difficulty of finding consistent improvements across metrics.