In this paper we address the question of the reliability of the predictions made by MT Quality Estimation (QE) systems.
we show that standard supervised QE systems, usually trained to minimize MAE, make serious mistakes at predicting the quality of the sentences in the tails of the quality range.