We utilized ROUGE-N metric (Lin, 2004) for benchmark, which is a standard for evaluating automatic summaries based on N-gram overlapping between a generated summary and a reference.
rOUGE-1 and rOUGE-2 F1-measure were used as our evaluation metrics.