by aggregating system summaries' ROUGE scores across multiple input documents, we can reliably rank summarisation systems by their quality.
rOUGE performs poorly at summary level: given multiple summaries for the same input document, rOUGE can hardly distinguish the "good" summaries from the "mediocre" and "bad" ones (Novikova et al., 2017).