MT evaluation is harder than evaluation of other NLP tasks, which makes it partially dependent on intuitive human judgements about text quality.
automated tools are capable of capturing and representing the "absolute" level of performance for MT systems, and this level could then be projected into task-dependent figures for harder or easier texts.