We examined how often an intrinsic metric correctly predicts the difference of the subjects' test performance on a problem.
for two translation methods A and B, we say an intrinsic metric M agrees with the CAR by the subjects on problem p i iff metric M scores A's translation of p i (= A(p i )) better than B's translation (= B(p i )) and the CAR is higher on A(p i ) than on B(p i ).