From this correlation analysis against human judgments, we observe that, as expected, the Language Model metric captures readability better than ROUGE, while falling short on relevance.
the results obtained using the proposed QA-based metrics indicate their potential benefits especially under the unsupervised setting, with QA conf and QA f score capturing readability and relevance better than all the others reported metrics, including ROUGE.