Existing preference-based interactive learning methods suffer from high sample complexity, i.e.
1b), responsible for querying preferences from the oracle and approximating the ranking of summaries, and an RL phase (the left cycle in Fig.