In our previous paper, we proposed a light weight, humanin-the-loop extrinsic evaluation scheme (Matsuzaki et al., 2015), where MT systems are evaluated by human subjects' scores on the second language ability tests translated to the subjects' native language by MT.
we used dialogue completion questions (Figure 1) as the test material.