Slightly more than 5% of ratings are more than two steps off.
comparing individual annotator ratings instead of mean ratings, some crowdsource annotators are a full nine steps off, and in a single case, even one of the trained annotators was eight steps off.