(2018) do not publish their code for metric calculation, we employ a popular NLG evaluation project available at https://github.com/ Maluuba/nlg-eval, and modify the scripts with the scores provided in the data according to the formulas in (Qin et al., 2018) to calculate all the metrics.
a news article and a comment is not a pair of parallel text.