We verified that the results of our automatic evaluation method are consistent with that of human evaluation for each question, and clarified that our method can be used for error analysis of grammatical items.
our method has high correlation with subjective evaluations by humans, even when only our method is used (which is comparable to conventional automatic evaluation methods and question-based evaluation by humans).