This is because, compared to the gold scores, the top or bottom predicted scores are closer to the centre of the range.
the sentences taken into account include some actual "tails sentences" (for which the absolute error is high), but they can also contain many sentences which actually belong to the area (for which the absolute error is low).