In order to carry out this study, we borrow methods from finance and econometrics that-to the best of our knowledge-have not been applied in natural language processing.
we use a local dependency measure recently proposed by Tjøstheim and Hufthammer (2013) to describe the relation between metric scores and human judgments at different levels of translation quality.