For example, the average number of segments per instance in TriviaQA-unfiltered is 20 even after pruning, while the total number of Transformer blocks is 12 or 24.
we propose to rank all segments using early-summarized hidden representations as a mechanism for efficiently retrieving few top-ranked segments.