In the worst case scenario, outliers introduce a high correlation when there is no association between metric and human scores for the rest of the systems.
future evaluations should also measure correlations after removing outlier systems.