The average Levenshtein edit distance (with words as the atomic unit, and with the score normalized to the interval [0,1]) between the original MT out- puts and the corrected sentences made by participants using The Chinese Room is 0.59; in contrast, the edit distance is shorter, at 0.40, when participants correct MT outputs directly.
in the next few subsections, we examine how these factors correlate with the quality of the participant corrections.