The most obvious deficiency in ROUGE is the lack of a linguistic quality measurement, which we take to encompass all language-related issues: lexical, syntactic, and semantic.
we conjecture that most remaining prediction error in Nouveau-ROUGE is a result of omitting linguistic quality and caution that better prediction would be achieved only for systems of comparable linguistic quality.