DP ratings were significantly correlated with the ratings provided by the two human raters who agreed well (_r = 0.32 and 0.31), resulting in agreement of ratings in 63% and 66% of the questions.
the agreement of ratings provided by the system and by two human raters is comparable to the highest agreement rate achieved between the human raters.