For the fine-grained analysis, we use instead the expedient of computing error distributions that are normalized with respect to the error counts observed in a bilingual reference system.
in addition to analyzing the behavior of bilingual and multilingual models, mainly, the zero-shot task requires a careful investigation.