(Paulus et al., 2017) combined supervised and reinforcement learning, demonstrating improvements over competing approaches both in terms of ROUGE and on human evaluation.
our experiments show that the best performing set of metrics consists of RoUGE-L in conjunction with QA conf and QA f score , both computed at an article-level, and hence unsupervised.