Further, both sets of experiments perform evaluations of mixed sets of human-produced and machine-produced summaries, so the results may be influenced by the ease of discriminating between a human and machine written summary.
for each of these questions, all summaries were manually rated on a scale from 1 to 5, in which 5 is the best.