Therefore, they all understand the translation almost the same way, even if the translation is incorrect.
we study the cost/benefit trade-off of using human annotators from different language backgrounds for the proposed evaluation metric, and compare whether providing the original source text helps.