DUC-05 contains 1,600 summaries (50 questions x 32 systems); in DUC-06, 1,750 summaries are included (50 questions x 35 Figure 2: Illustration of different flavors of the investigated neural QE methods.
the three fine-tuned BERt versions clearly outperform all other methods.