Suppose the first sentence is ranked A, the second B, and the third C in Table 1  Sometimes question-answering (QA) by human subjects is used for evaluation (Morris et al., 1992;Hirao et al., 2001).
human subjects judge whether predefined questions can be answered by reading only a machine generated summary.