However, these numbers are misleading as the rating scale is ordinal and almost all the disagreements were the result of grading a story either one rank better or worse.
rater A usually marked incomplete stories as poor while the other raters assigned partial credit.