Hopefully, QE systems will progress towards this kind of behaviour, but currently the evaluation methods are not entirely satisfactory from this perspective.
after describing our experimental setting in §2, we will observe in §3 that the use of the Mean Absolute Error 1 (MAE) as a global evaluation measure hides huge discrepancies in the distribution of errors among the range of scores.