Annotators assigned scores on a fivepoint scale, with 1 and 5 indicating that the summary is bad or good with respect to a specific Q.
differences among systems are thus small in this respect, and although SUM-QE predicts scores in this range, it struggles to put them in the correct order, as illustrated in Figure 3.