To address this issue, we propose a novel approach for manual evaluation, HIGHlight-based Reference-less Evaluation of Summarization (HIGHRES), in which summaries are assessed by multiple annotators against the source document via manually highlighted salient content in the latter.
summary assessment on the source document by human judges is facilitated, while the highlights can be used for evaluating multiple systems.