We provide empirical evidence for this conjecture by comparing BANDITSUM to the sequential RL model proposed by Wu and Hu (2018) (Figure 2) on two subsets of the data: one with good summary sentences appearing early in the article, while the other contains articles where good summary sentences appear late.
we construct two evaluation datasets by selecting the first 50 documents (D early , i.e., best summary occurs early) and the last 50 documents (D late , i.e., best summary occurs late) from a sample of 1000 documents that is ordered by the average extractive label index idx.