The performance of NetSum with third-party features over NetSum without third-party features is statistically significant at 95% confidence.
netSum still outperforms the baseline without thirdparty features, leading us to conclude that Ranknet and simple position and term frequency features contribute the maximum performance gains, but increased ROUGE-1 and ROUGE-2 scores are a clear benefit of third-party features.