However, different evaluators focused on different aspects of the translations, which increased the subjectivity of their judgments.
evaluations suffered from low inter-and intra-annotator agreements (Turian et al., 2003;Snover et al., 2006).