Even though ROUGE-SU4 measurement seems to have more discriminative power, it is at least puzzling that it cannot distinguish between the model and the automatically produced summaries.
placing the rule-based coarse-grained summaries and the model ones in the same group directly contradicts the results reported in Section 6.2-that people find the model summaries far superior to this particular type of summary produced by our summarizer.