There has been much work on improving the quality of automatic metrics.
there is interest in learning models (Lowe et al., 2017a;Dusek et al., 2017) that are able to optimize for improved correlations with human judgment.