A common way of assessing the performance of a new automatic image captioning metric is to analyze how well it correlates with human judgements of description quality.
in the literature, there is no consensus on which correlation coefficient is best suited for measuring the soundness of a metric in this way.