We developed our metric mainly for automatic evaluation of translation quality for distant language pairs such as Japanese-English, but we also want to know how well the metric works for similar language pairs.
we also use the WMT-07 data (Callison-Burch et al., 2007) that covers only European language pairs.