Since the inception of BLEU, evaluation of automatic metrics in MT has been by correlation with human assessment.
in summarization, over the years since the introduction of ROUGE, summarization evaluation has seen a variety of different methodologies applied to evaluation of its metrics.