Although attempts have been made at automating the evaluation of summaries, none is so good as to remove the need for human assessors.
the results are encouraging; it seems that removing noisy topics from training data does improve the correlations with manual metrics in most cases.