Note that we randomly picked two judges to rate each dialog so that different dialogs are rated by different pairs of judges and one pair of judges only worked on one dialog together.
the kappa agreements here do not reflect the agreement of one pair of judges.